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Abstract 

This paper aims to solve two fundamental problems on finite or infinite horizon 
dynamic games with perfect or almost perfect information. Under some mild 
conditions, we prove (1) the existence of subgame-perfect equilibria in general 
dynamic games with almost perfect information, and (2) the existence of pure- 
strategy subgame-perfect equilibria in perfect-information dynamic games with 
uncertainty. Our results go beyond previous works on continuous dynamic games 
in the sense that public randomization and the continuity requirement on the 
state variables are not needed. As an illustrative application, a dynamic stochastic 
oligopoly market with intertemp orally dependent payoffs is considered. 
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1 Introduction 


Dynamic games with complete information and subgame-perfect equilibria are 
fundamental game-theoretic concepts with wide applications 1 . For games with 
finitely many actions and stages, Selten (1965) showed the existence of subgame- 
perfect equilibria. The infinite horizon but finite-action case is covered by 
Fudenberg and Levine (1983). 

Since the agents in many economic models need to make continuous choices, 
it is important to consider dynamic games with general action spaces. For 
deterministic continuous games with perfect information where only one player 
moves at each stage and all previous moves are observable by the players, the 
existence of pure-strategy subgame-perfect equilibria is shown in Harris (1985), 
Hellwig and Leininger (1987), Borgers (1989, 1991) and Hellwig et al. (1990). 
However, if the deterministic assumption is dropped by introducing a passive 
player - Nature, then pure-strategy subgame-perfect equilibrium need not exist 
as shown by a four-stage game in Harris, Reny and Robson (1995, p. 538). In 
fact, Luttmer and Mariotti (2003) even demonstrated the nonexistence of mixed- 
strategy subganre-perfect equilibrium in a five-stage game. Thus, it has remained 
an open problem to prove the existence of (pure or mixed-strategy) subgame- 
perfect equilibria in (finite or infinite horizon) perfect-information dynamic games 
with uncertainty under some general condition. 

Harris, Reny and Robson (1995) considered continuous dynamic games with 
almost perfect information. In such games, there is a finite number of active players 
and a passive player, Nature. The players (active and passive) know all the previous 
moves and choose their actions simultaneously. All the relevant model parameters 
are assumed to be continuous in both action and state variables (i.e., Nature’s 
moves). Harris, Reny and Robson (1995) showed the existence of subgame-perfect 
correlated equilibria by introducing a public randomization device, 2 3 and also 
demonstrated the possible nonexistence of subgame-perfect equilibrium through 
a simple example with two players in each of the two stages. This means that the 
existence of subgame-perfect equilibria under some suitable condition is an open 
problem even for two-stage dynamic games with almost perfect information. 

For dynamic games with perfect or almost perfect information, the earlier 
works have focused on continuous dynamic games. The purpose of this paper 
is to solve the two open problems for (finite or infinite horizon) general dynamic 
games in which the relevant model parameters are assumed to be continuous in 
actions, but only measurable in states. 2 In particular, we show the existence of 

1 See, for example, Part II of Fudenberg and Tirole (1991). 

2 See also Mariotti (2000) and Reny and Robson (2002). 

3 While continuity in terms of actions is natural and widely adopted, the state continuity requirement 
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a subgame-perfect equilibrium in a general dynamic game with almost perfect 
information under some suitable conditions on the state transitions. Theorem 1 
(and also Proposition 2) below goes beyond earlier works on continuous dynamic 
games by dropping public randomization and the continuity requirement on 
the state variables. Thus, the class of games considered here includes general 
stochastic games, where the stage payoffs are usually assumed to be continuous 
in actions and measurable in states. * * * 4 Proposition 1 also presents some regularity 
properties of the equilibrium payoff correspondences, including compactness and 
upper hemicontinuity in the action variables. 5 As an illustrative application of 
Theorem 1, we consider a dynamic oligopoly market in which firms face stochastic 
demand/cost and intertemporally dependent payoffs. 

We work with the condition that the state transition in each period (except for 
those periods with one active player) has a component with a suitable density 
function with respect to some atomless reference measure. This condition is 
also minimal in the particular sense that the existence result may fail to hold 
if (1) the passive player, Nature, is not present in the model as shown in 
Harris, Reny and Robson (1995), or (2) with the presence of Nature, the reference 
measure is not atomless as shown in Luttmer and Mariotti (2003). 

For the special class of continuous dynamic games with almost perfect 
information, we can weaken the atomless reference measure condition slightly. 

In particular, we simply assume the state transition in each period (except for 
those periods with one active player) to be an atomless probability measure for 
any given history, without the requirement of a common reference measure. Thus, 
the introduction of a public randomization device as in Harris, Reny and Robson 
(1995) is an obvious special case. 

For dynamic games with almost perfect information, our main result allows 
the players to take mixed strategies. However, for the special class of dynamic 
games with perfect information 6 , we obtain the existence of pure-strategy subgame- 
perfect equilibria in Corollaries 2 and 3. When Nature is present, the only known 
general existence result for dynamic games with perfect information is, to the 

as in continuous dynamic games is rather restrictive. The state measurability assumption is the minimal 

regularity condition one would expect for the model parameters. 

Proposition 2 implies a new existence result on subgame-perfect equilibrium for a general stochastic 

game; see Remark 2 below. 

5 Such an upper hemicontinuity property in terms of correspondences of equilibrium payoffs, 
or outcomes, or correlated strategies has been the key for proving the relevant existence results 
as in Harris (1985), Hellwig and Leininger (1987), Borgers (1989, 1991), Hellwig et al. (1990), 
Harris, Reny and Robson (1995) and Mariotti (2000). 

6 Dynamic games with perfect information do have wide applications. For some examples, see 
Phelps and Poliak (1968) for an intergenerational bequest game, and Peleg and Yaari (1973) and 
Goldman (1980) for intrapersonal games in which consumers have changing preferences. 
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best of our knowledge, for continuous games with public randomization. On the 
contrary, our Corollary 2 needs neither continuity in the state variables nor public 
randomization. Furthermore, our Corollary 3 provides a new existence result for 
continuous dynamic games with perfect information, which generalizes the results 
of Harris (1985), Hellwig and Leininger (1987), Borgers (1989), and Hellwig et al. 

(1990) to the case when Nature is present. 

We follow the standard three-step procedure in obtaining subganre-perfect 
equilibria of dynamic games, namely, backward induction, forward induction, 
and approximation of infinite horizon by finite horizon. Because we drop public 
randomization and the continuity requirement on the state variables, new technical 
difficulties arise in each step of the proof. In the step of backward induction, we 
obtain a new existence result for discontinuous games with stochastic endogenous 
sharing rules, which extends the main result of Simon and Zame (1990) by allowing 
the payoff correspondence to be measurable (instead of upper hemicontinuous) 
in states. For forward induction, we need to obtain strategies that are jointly 
measurable in history. When there is a public randomization device, the joint 
measurability follows from the measurable version of Skorokhod’s representation 
theorem and implicit function theorem respectively as in Harris, Reny and Robson 
(1995) and Reny and Robson (2002). Here we need to work with the deep 
“measurable” measurable choice theorem of Mertens (2003). Lastly, in order 
to obtain results for the infinite horizon case, we need to handle various subtle 
measurability issues due to the lack of continuity on the state variables in our 
model. 1 As noted in Subsection 5.5 below, a considerably simpler proof could be 
obtained for the case of continuous dynamic games. 

The rest of the paper is organized as follows. The model and main result are 
presented in Section 2. An illustrative application of Theorem 1 to a dynamic 
oligopoly market with stochastic demand/cost and intertemporally dependent 
payoffs is given in Section 3. Section 4 provides several variations of the main 
result. All the proofs are left in the Appendix. 

2 Model and main result 

In this section, we shall present the model for an infinite-horizon dynamic game 
with almost perfect information. 

The set of players is Iq = {0,1,..., n}, where the players in I = {1,..., n} are 
active and player 0 is Nature. All players move simultaneously. Time is discrete, 
and indexed by t = 0,1,2,.... 

7 We cannot adopt the usual method of approximating a limit continuous dynamic game by a sequence 
of finite games as used in Hellwig et al. (1990), Borgers (1991) and Harris, Reny and Robson (1995). 
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The set of starting points is a closed set Hq = Xq x So, where Xq is a compact 
metric space and So is a Polish space (that is, a complete separable metric space ). 8 
At stage t > 1, player V s action will be chosen from a subset of a Polish space X t/l 
for each i £ I, and X t = n i£i Xu. Nature’s action is chosen from a Polish space 
St- Let X 1 = n 0 <*< t *fc and = Uo<k<tSk- The Borel <r-algebras on X t and 
St are denoted by B(X t ) and B(St), respectively. Given t > 0 , a history up to the 
stage t is a vector 

h t = (xo,s 0 ,xi,si,...,x t ,s t ) £ X 1 x S*. 

The set of all such possible histories is denoted by Ht- For any t > 0, Ht C X t x S t . 

For any t > 1 and i £ I, let A t i be a measurable, nonempty and compact 
valued correspondence from H t -\ to X t i such that (1) A t i is sectionally continuous 
on A - * -1 , 9 and (2) Attiht-i) is the set of available actions for player i £ I given 
the history ht- i - 10 Let A t = Hie I Ati- Then H t = Gr (A 1 ) x St, where Gr(A*) is 
the graph of A t . 

For any x = (xo,x \,...) € X°°, let x f = (.To,..., xt) £ X 1 be the truncation of 
x up to the period t. Truncations for s £ S°° can be defined similarly. Let H^ be 
the subset of X°° x S°° such that (x, s) £ H 00 if (x 1 , s*) £ H t for any t > 0. Then 
LToo is the set of all possible histories in the game . 11 

For any t > 1, Nature’s action is given by a Borel measurable mapping fto from 
H t -1 to Xi(St) such that fto is sectionally continuous on A 1-1 , where Xi(St) is 
endowed with the topology induced by the weak convergence . 12 For each t > 0, 
suppose that A t is a Borel probability measure on St and A t is atomless for t > 1. 

Let A* = < 8 >o<fc<tAt for t > 0. We shall assume the following condition on the state 
transitions. 

Assumption 1 (Atomless Reference Measure (ARM)). A dynamic game is said 
to satisfy the “atomless reference measure (ARM)” condition if for each t >1, 

1. the probability fto(-\ht-i) is absolutely continuous with respect to A t on St 

8 In each stage t > 1, there will be a set of action profiles X t and a set of states St- Without loss of 
generality, we assume that the set of initial points is also a product space for notational consistency. 

9 Suppose that Yi, Y 2 and Y 3 are all Polish spaces, and Z C Y\ x Y 2 . Denote Z(y\) = {y 2 £ 
Y 2 : (yi, y 2 ) £ Z} for any y\ £ Y\. A function (resp. correspondence) /: Z —> Y 3 is said to be sectionally 
continuous on Y 2 if f(yi, •) is continuous on Z(y{) for all y\ with Z(yi) 7 ^ 0. Similarly, one can define 
the sectional upper hemicontinuity for a correspondence. 

10 Suppose that Y and Z are both Polish spaces, and ’P is a correspondence from Y to Z. Hereafter, 
the measurability of ^P, unless specifically indicated, is with respect to the Borel cr-algebra B(Y) on Y. 

11 A finite horizon dynamic game can be regarded as a special case of an infinite horizon dynamic 
game in the sense that the action correspondence A t i is point-valued for each player i £ I and t >T for 
some stage T > 1; see, for example, Borgers (1989) and Harris, Reny and Robson (1995). 

12 For a Polish space A, A4(A) denotes the set of all Borel probability measures on A, and A (A) is 
the set of all finite Borel measures on A. 
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with the Radon-Nikodym derivative ipto(ht-i, St) for all ht-i G H t - 1; 13 

2. the mapping <p t o is Borel measurable and sectionally continuous in X l ~ l , and 
integrably bounded in the sense that there is a Xt-integrable function (ft - St —>• 
R + such that tpto(ht~i, St) < (ft(st) for any ht- 1 G H t - 1 and st G St- 

For each i G I, the payoff function m is a Borel measurable mapping from 
to M++ which is sectionally continuous on X°° and bounded by 7 > 0 . 11 

When one considers a dynamic game with infinite horizon, the following 
“continuity at infinity” condition is standard . 15 In particular, all discounted 
repeated games or stochastic games satisfy this condition. 

For any T > 1, let 


w T = sup \ui(x, s) — Ui(x, s)|. ( 1 ) 

iei 

(x,s)eH oo 
{x,s)eHoo 
X T ~ 1 =X T ~l 
s T- 1= -T-l 

Assumption 2 (Continuity at Infinity). A dynamic game is said to be “continuous 
at infinity” if vj t —» 0 as T —>• 00 . 

For player i G I, a strategy fi is a sequence {fti}t> 1 such that fu is a Borel 
measurable mapping from H t - 1 to JA(Xu ) with fu(Ati(ht-i)\ht-i) = 1 for all 
ht -1 G H t - 1 - A strategy profile / = {./)}*gr is a combination of strategies of all 
active players. 

In any subgame, a strategy combination will generate a probability distribution 
over the set of possible histories. This probability distribution is called the path 
induced by the strategy combination in this subgame. 

Definition 1. Suppose that a strategy profile f = and a history h t G H t are 

given for some t > 0. Let r t = 5h t , where 8h t is the probability measure concentrated 
at the one point h t . If Ty G Xi(H t >) has already been defined for some t' > t, then 
let 

Tf+i = T t ’ o (<8>ie/ 0 /(t'+i)i)- 16 

13 It is common to have a reference measure when one considers a game with uncountable states. For 
example, if S t is a subset of R z , then the Lebesgue measure is a natural reference measure. 

14 Since Ui is bounded, we can assume that the value of the payoff function is strictly positive without 
loss of generality. 

15 See, for example, Fudenberg and Levine (1983). 

16 Denote ®iei 0 f(t'+i)i as a transition probability from H t > to Ai(X t '+ 1 ). Notice that the strategy 
profile is usually represented by a vector. For the notational simplicity later on, we assume that 
®iei 0 f(t'+i)i(-\hf) represents the strategy profile in stage t' + 1 for a given history hf G H t > , where 
®iei 0 f(t'+i)i(-\hf) is the product of the probability measures f(t'+i)i(-\hf), i G /o- If A is a finite 
measure on X and v is a transition probability from X to F, then A o v is a measure on X x Y such 
that A o o(A x B) = f A ^(I3|a;)A(da;) for any measurable subsets A C X and B C Y . 
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Finally, let r £ .M(-ffoo) be the unique probability measure on such that 
Marg Ht j = r t i for all t' > t. Then r is called the path induced by f in the 
subgame ht ■ For all i £ I, J H Ui dr is the payoff of player i in this subgame. 

The notion of subgame-perfect equilibrium is defined as follows. 

Definition 2 (SPE). A subgame-perfect equilibrium is a strategy profile f such 
that for all i £ / , t > 0, and A 4 - almost all ht € H t , r ' player i cannot improve his 
payoff in the subgame h t by a unilateral change in his strategy , 18 

The following theorem is our main result, which shows the existence of a 
subgame-perfect equilibrium under the conditions of ARM and continuity at 
infinity. Its proof is left in the appendix. 

Theorem 1. If a dynamic game satisfies the ARM condition and is continuous at 
infinity, then it possesses a subgame-perfect equilibrium. 

Let E t {ht- 1 ) be the set of subganre-perfect equilibrium payoffs in the subgame 
ht~ i- The following result demonstrates the compactness and upper hemicontinuity 
properties of the correspondence E t . 

Proposition 1. If a dynamic game satisfies the ARM condition and is continuous 
at infinity, then E t is nonempty and compact valued, and essentially sectionally 
upper hemicontinuous on A 4 " 1 . 19 


3 Dynamic oligopoly market with sticky prices 

In this section, we consider a dynamic oligopoly market in which firms face 
stochastic demand/cost and intertemporally dependent payoffs. Such a model 
is a variant of the well-known dynamic oligopoly models as considered in 
Green and Porter (1984) and Rotemberg and Saloner (1986), which examined the 
response of firms for demand fluctuations. The key feature of our example is the 
existence of sticky price effect, which means that the desirability of the good from 
the demand side could depend on the accumulated past output, and hence gives 
intertemporally dependent payoff functions. 

17 A property is said to hold for A 4 -almost all h t = ( x *, s 4 ) £ H t if it is satisfied for A 4 -almost all s 4 £ S ' 4 
and all x* £ R t (s 4 ). 

18 When the state space is uncountable and has a reference measure, it is natural to 
consider the optimality for almost all sub-histories in the probabilistic sense; see, for example, 
Abreu, Pearce and Stacchetti (1990) and Footnote 4 therein. 

19 Suppose that Y\, Y 2 and I 3 are all Polish spaces, and Z C Yi x Y 2 and ?y is a Borel probability measure 
on Yi. Denote Z(y 1 ) = {y 2 £ Y 2 : ( 3/1 , 2/2 ) £ Z} for any y 1 £ Yi. A function (resp. correspondence) 
/: Z —> I 3 is said to be essentially sectionally continuous on Y 2 if f{yi, •) is continuous on Z(yf) for rj- 
almost all y\. Similarly, one can define the essential sectional upper hemicontinuity for a correspondence. 



We consider a dynamic oligopoly market in which n firms produce a homoge¬ 
neous good in an infinite-horizon setting. The inverse demand function is denoted 
by PtfQi, ■ ■ ■ ,Qt, St), where Qt is the industry output and -St the observable demand 
shock in period t. Notice that the price depends on the past outputs. One possible 
reason could be that the desirability of consumers will be influenced by their 
previous consumptions, and hence the price does not adjust instantaneously. We 
assume that Pt is a bounded function which is continuous in (Q \,..., Q t ) and 
measurable in st . In period t , the shock st is selected from the set St = [at, bt\. 
We denote firm V s output in period t by qu so that Qt = Qti- The cost of 

firm i in period t is cu{qu,st .) given the output qu and the shock st, where cu is a 
bounded function continuous in qu and measurable in st- The discount factor of 
firm i is fa € [0,1). 

The timing of events is as follows. 

1. At the beginning of period t, all firms learn the realization of st, which 

is determined by the law of motion Qi,..., st-i, Qt-i)- Suppose 

that Kt(-\s\,Qi,..., st-i,Qt-i) is absolutely continuous with respect to the 
uniform distribution on St with density <pt(si, Qi ,..., st-i, Qt-u s t), where 
ft is bounded, continuous in (Q i,..., Qt-i) and measurable in (si, ..., st). 

2. Firms then simultaneously choose the level of their output q t = (q t i,..., qtn), 
where qu € A t i(st,Qt- 1 ) Q for i = 1,2, ...,n. In particular, the 
correspondence Au gives the available actions of firm i, which is nonempty 
and compact valued, measurable in st, and continuous in Qt- 1 . 

3. The strategic choices of all the firms then become common knowledge and 
this one-period game is repeated. 

In period t. given the shock s t and the output {qk}i<k<t U P to time t with 
Qk = ( qki, ■ ■ ■, Qkn), the payoff of firm i is 


u t i{qi, ■ ■ ■, qt, s t ) 


n n 

PtC}2qij,...,^2qtj,St) 

j =1 3 = 1 


Cti (Qtii St) 


Qti • 


Given a sequence of outputs {qt}t> l and shocks {«t}i>i, firm i receives the payoff 

oo 

uu(qi,si) + y ~' j /3 t i ~ 1 'Uti(qi,.. .,qt,s t ). 

t =2 


Remark 1. Our dynamic oligopoly model has a non-stationary structure. In 
particular, the transitions and payoffs are history-dependent. The example captures 
the scenario that the price of the homogeneous product does not adjust instanta¬ 
neously to the price indicated by its demand function at the given level of output. 
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For more applications with intertemporally dependent utilities, see, for example, 
Ryder and Heal (1973), Fershtman and Kamien (1987) and Becker and Murphy 
(1988). If the model is stationary and the inverse demand function only depends 
the current output, then the example reduces to he the dynamic oligopoly game with 
demand fluctuations as considered in Rotemberg and Saloner (1986). 

By condition (1) above, the ARM condition is satisfied. It is also easy to see 
that the game is continuous at infinity. By Theorem 1, we have the following result. 

Corollary 1. The dynamic oligopoly market possesses a subgame-perfect equilib¬ 
rium. 


4 Variations of the main result 

In this section, we will consider several variations of our main result. 

In Subsection 4.1, we still consider dynamic games whose parameters are 
continuous in actions and measurable in states. We partially relax the ARM 
condition in two ways. First, we allow the possibility that there is only one 
active player (but no Nature) at some stages, where the ARM type condition 
is dropped. Second, we introduce an additional weakly continuous component on 
the state transitions at any other stages. In addition, we allow the state transition 
in each period to depend on the current actions as well as on the previous history. 
Thus, we combine the models for dynamic games with perfect and almost perfect 
information. We show the existence of a subgame perfect equilibrium such that 
whenever there is only one active player at some stage, the player can play pure 
strategy as part of the equilibrium strategies. As a byproduct, we obtain a new 
existence result for stochastic games. The existence of pure-strategy subgame- 
perfect equilibria for dynamic games with perfect information (with or without 
Nature) is provided as an immediate corollary. 

In Subsection 4.2, we consider the special case of continuous dynamic games 
in the sense that all the model parameters are continuous in both action and 
state variables. We can obtain the corresponding results under a slightly weaker 
condition. All the previous existence results for continuous dynamic games with 
perfect and almost perfect information are covered as our special cases. 

We will follow the setting and notations in Section 2 as closely as possible. For 
simplicity, we only describe the changes we need to make on the model. All the 
proofs are left in the appendix. 
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4.1 Dynamic games with partially perfect information 
and a generalized ARM condition 

In this subsection, we will generalize the model in Section 2 in three directions. 
The ARM condition is partially relaxed such that (1) perfect information may be 
allowed in some stages, and ( 2 ) the state transitions have a weakly continuous 
component in all other stages. In addition, the state transition in any period can 
depend on the action profile in the current stage as well as on the previous history. 
The fist change allows us to combine the models of dynamic games with perfect 
and almost perfect information. The second generalization implies that the state 
transitions need not be norm continuous in the Banach space of finite measures. 
The last modification covers the model of stochastic games as a special case. 

The changes are described below. 

1. The state space is a product space of two Polish spaces; that is, St = St x St 
for each t > 1 . 

2. For each i € /, the action correspondence Au from Ht-i to Xu is measurable, 
nonempty and compact valued, and sectionally continuous on X 4-1 X S' 4-1 . 
The additional component of Nature is given by a measurable, nonempty 
and closed valued correspondence A t o from Gr(At) to S' 4 , which is sectionally 
continuous on A 4 x S 4-1 . Then H t = Gr(Ato) x St, and Hqq is the subset of 
X°° x S°° such that (x, s ) € H a 0 if (x 4 , s 4 ) £ H t for any t > 0. 

3. The choices of Nature depend not only on the history ht- 1 , but also on the 
action profile xt in the current stage. The state transition fto(ht-i,xt) = 
fto(ht-i,x t ) o fto(ht-i,x t ), where f t0 is a transition probability from Gr(A*) 
to M(S t ) such that fto(A t o(h t -i, x t )\h t -i, x t ) = 1 for all (h t -i,x t ) £ Gr (A t ), 
and fto is a transition probability from Gr(A t o) to M(St). 

4. For each i £ /, the payoff function m is a Borel measurable mapping from 

to M ++ which is bounded by 7 > 0 , and sectionally continuous on X°° x S°°. 

We allow the possibility for the players to have perfect information in some 
stages. For t > 1, let 


1 , 


N t = 


0 , 


if fto(h t -i,x t ) = S st for some s t and 
\{i £ I: A t i is not point valued}| = 1; 
otherwise, 


where \K\ represents the number of points in the set K. Thus, if Nt = 1 for some 
stage t, then the player who is active in the period t is the only active player and 
has perfect information. 
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We will drop the ARM condition in those periods with only one active player, 
and weaken the ARM condition in other periods. 

Assumption 3 (ARM 7 ). 1. For any t > 1 with Nt = 1, St is a singleton set 

{st} and A t = 5g t . 

2. For each t > 1 with Nt = 0, fto is sectionally continuous on X 1 x S' 4 . The 

probability measure ftof\ht-i,xt, §t.) is absolutely continuous with respect to 
an atomless Borel probability measure A t on St for all (h t -i,xt, §t ) £ Gr{A t o), 
and ipto(ht-i,xt,st,st) is the corresponding density . 20 

3. The mapping ipto is Borel measurable and sectionally continuous on A' 4 x 
5 4 , and integrably bounded in the sense that there is a Xt-integrable function 
4>t.: S t -» M + such that p t0 (h t -i,xt,st,s t ,) < (ft(s t ) for any (h t -i,x t ,s t ). 

The following proposition shows that the existence result is still true in this 
more general setting. 

Proposition 2. If an infinite-horizon dynamic game satisfies the ARAB condition 
and is continuous at infinity, then it possesses a subgame-perfect equilibrium f. In 
particular, for j £ I and t > 1 such that N t = 1 and player j is the only active 
player in this period, ftj can be deterministic. Furthermore, the equilibrium payoff 
correspondence Et is nonempty and compact valued, and essentially sectionally 
upper hemicontinuous on A 4 ^ 1 x 5 4-1 . 

Remark 2. The proposition above also implies a new existence result of subgame- 
perfect equilibria for stochastic games. Consider a standard stochastic game with 
uncountable states as in Mertens and Parthasarathy (1987). Mertens and Parthasarathy 
(1987) proved the existence of a subgame-perfect equilibrium by assuming the state 
transitions to be norm continuous with respect to the actions in the previous stage. 

On the contrary, our Proposition 2 allows the state transitions to have a weakly 
continuous component. 

Dynamic games with perfect information is a special class of dynamic games 
in which players move sequentially. As noted in Footnote 6, such games have 
been extensively studied and found wide applications in economics. As an 
immediate corollary, an equilibrium existence result for dynamic games with perfect 
information is given below. 

Corollary 2. If a dynamic game with perfect information satisfies the ARM 
condition and is continuous at infinity, then it possesses a pure-strategy subgame- 
perfect equilibrium. 

20 In this subsection, a property is said to hold for A 4 -almost all ht G H t if it is satisfied for A 4 -almost 
all s 4 G S l and all (a; 4 ,s 4 ) G R t (5 4 ). 
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4.2 Continuous dynamic games with partially perfect 
information 


In this subsection, we will study an infinite-horizon dynamic game with a 
continuous structure. As in the previous subsection, we allow the state transition 
to depend on the action profile in the current stage as well as on the previous 
history, and the players may have perfect information in some stages. 

1. For each t > 1, the choices of Nature depends not only on the history h t - 1 , but 
also on the action profile xt in this stage. For any t > 1, suppose that A t o is a 
continuous, nonempty and closed valued correspondence from Gr(A t ) to St- 
Then H t = Gr(A t o), and is the subset of X°° x S°° such that (x , s) € 

if (x*, s 4 ) € H t for any t > 0. 

2. Nature’s action is given by a continuous mapping f t o from Gr(At) to A4(St) 
such that f t0 (A t0 (h t -i, x t )\h t -i, x t ) = 1 for all (h t -i,x t ) € Gr (A t ). 

3. For each t > 1, let 



0 


if fto(ht-i,x t ) = S st for some s t and 
\{i £ I: A t i is not point valued}| = 1; 
otherwise. 


Definition 3. A dynamic game is said to be continuous if for each t and i, 

1. the action correspondence An is continuous on H t - 

2. the transition probability fto is continuous on Gr(A t ); 

3. the payoff function Ui is continuous on H . 

Note that the “continuity at infinity” condition is automatically satisfied in a 
continuous dynamic game. 

Next, we propose the condition of “atomless transitions” on the state space, 
which means that the state transition is an atomless probability measure in any 
stage. This condition is slightly weaker than the ARM condition. 

Assumption 4 (Atomless Transitions). 1. For any t > 1 with A} = 1, St is a 
singleton set {st}. 

2. For each t > 1 with N t = 0, fto(ht-i) is an atomless Borel probability measure 
for each ht -1 € H t -\. 

Since we work with continuous dynamic games, we can adopt a slightly stronger 
notion of subgame-perfect equilibrium. That is, each player’s strategy is optimal 
in every subgame given the strategies of all other players. 
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Definition 4 (SPE 7 ). A subgame-perfect equilibrium is a strategy profile f such 
that for all i € I, t > 0, and all h t € H t , player i cannot improve his payoff in the 
subgame ht by a unilateral change in his strategy. 

The result on the equilibrium existence is presented below. 

Proposition 3 . If a continuous dynamic game has atomless transitions, then it 
possesses a subgame-perfect equilibrium f. In particular, for j € I and t > 1 
such that N t = 1 and player j is the only active player in this period, ftj can 
be deterministic. In addition, Et is nonempty and compact valued, and upper 
hemicontinuous on Ht -1 for any t > 1. 

Remark 3. Proposition 3 goes beyond the main result of Harris, Reny and Robson 
(1995). They proved the existence of a subgame-perfect correlated equilibrium 
in a continuous dynamic game with almost perfect information by introducing a 
public randomization device, which does not influence the payoffs, transitions or 
action correspondences. It is easy to see that their model automatically satisfies the 
condition of atomless transitions. The state in our model is completely endogenous 
in the sense that it affects all the model parameters such as payoffs, transitions, 
and action correspondences. 

Remark 4. Proposition 3 above provides a new existence result for continuous 
stochastic games. As remarked in the previous subsection, the existence of subgame- 
perfect equilibria has been proved for general stochastic games with a stronger 
continuity assumption on the state transitions, namely the norm continuity. On 
the contrary, we only need to require the state transitions to be weakly continuous. 

Remark 5. The condition of atomless transitions is minimal. In particular, the 
counterexample provided by Luttmer and Mariotti (2003), which is a continuous 
dynamic game with perfect information and Nature, does not have any subgame- 
perfect equilibrium. In their example, Nature is active in the third period, but the 
state transitions could have atoms. Thus, our condition of atomless transitions is 
violated. 

The next corollary follows from Proposition 3, which presents the existence 
result for continuous dynamic games with perfect information (and Nature). 

Corollary 3. If a continuous dynamic game with perfect information has atomless 
transitions, then it possesses a pure-strategy subgame-perfect equilibrium. 

Remark 6. Harris (1985), Hellwig and Leininger (1987), Borgers (1989) and 
Hellwig et al. (1990) proved the existence of subgame-perfect equilibria in contin¬ 
uous dynamic games with perfect information. In particular, Nature is absent in 
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all those papers. Luttmer and, Mariotti (2003) provided an example of a five-stage 
continuous dynamic game with perfect information, in which Nature is present and 
no subgame-perfect equilibrium exists. The only known general existence result, 
to the best of our knowledge, for (finite or infinite horizon) continuous dynamic 
games with perfect information and Nature is the existence of subgame-perfect 
correlated equilibria via public randomization as in Harris, Reny and Robson 
(1995). Corollary 3 covers all those existence results as special cases. 

5 Appendix 

5.1 Technical preparations 

In this subsection, we present several lemmas as the mathematical preparations for 
proving Theorem 1. Since correspondences will be used extensively in the proofs, 
we collect, for the convenience of the reader, several known results as lemmas. 

Let (S,S) be a measurable space and X a topological space with its Borel a- 
algebra B(X). A correspondence T from S to X is a function from S to the space 
of all subsets of X. The upper inverse of a subset dCJis 

T M (A) = {seS: T(s) C A}. 

The lower inverse of a subset A C X is 

¥(A) = {s <E S: T(s) PI A 0}. 

The correspondence T is 

1. weakly measurable, if \E^(0) G S for each open subset O Cl; 

2. measurable, if \K ) G S for each closed subset K C X. 

The graph of T is denoted by Gr(T) = {(s,x) GSxX:sGS,iG T(s)}. The 
correspondence T is said to have a measurable graph if Gr(T) G S <S> B(X). 

If S is a topological space, then T is 

1. upper hemicontinuous, if T“(0) is open for each open subset OCX; 

2. lower hemicontinuous, if is open for each open subset O C X. 

Lemma 1. Suppose that X is a Polish space and /C is the set of all nonempty 
compact subsets of X endowed with the Hausdorff metric topology. Then X is a 
Polish space. 
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Proof. By Theorem 3.88 (2) of Aliprantis and Border (2006), 1C is complete. In 
addition, Corollary 3.90 and Theorem 3.91 of Aliprantis and Border (2006) imply 
that 1C is separable. Thus, 1C is a Polish space. □ 

Lemma 2. Let (S,S) be a measurable space, X a Polish space endowed with the 
Borel a-algebra B(X), and 1C the space of nonempty compact subsets of X endowed 
with its Hausdorff metric topology. Suppose that T: S —> X is a nonempty and 
closed valued correspondence. 

1. //T is weakly measurable, then it has a measurable graph. 

2. If T is compact valued, then the following statements are equivalent. 

(a) The correspondence T is weakly measurable. 

(b) The correspondence T is measurable. 

(c) The function f:S—>)C, defined by f(s) = \H(s), is Borel measurable. 

3. Suppose that S is a topological space. If \h is compact valued, then the 
function f: S —» 1C defined by f(s) = 'h(s) is continuous if and only if the 
correspondence 'h is continuous. 

4- Suppose that ( S , S, A) is a complete probability space. Then 'P is S-measurable 
if and only if it has a measurable graph. 

5. For a correspondence T: S —>• X between two Polish spaces, the following 
statements are equivalent. 

(a) The correspondence T is lower hemicontinuous at a point s E S. 

(b) If s n s, then for each x E \I/(s), there exist a subsequence {s nfe } of 
K} and elements Xk E T(s nfc ) for each k such that Xk —>• x. 

6. For a correspondence T: S —>• X between two Polish spaces, the following 
statements are equivalent. 

(a) The correspondence 'h is upper hemicontinuous at a point s E S and 
^(s) is compact. 

(b) If a sequence (s n , x n ) in the graph of'If satisfies s n —» s, then the sequence 
{x n } has a limit in T(s). 

7. Given correspondences F : X Y and G : Y —f Z, the composition F and G 
is defined by 

G(F(x)) = U y<z F {x)G{y). 

The composition of upper hemicontinuous correspondences is upper hemicon¬ 
tinuous. The composition of lower hemicontinuous correspondences is lower 
hemicontinuous. 
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Proof. Properties (1), (2), (3), (5), (6) and (7) are Theorems 18.6, 18.10, 17.15, 

17.20, 17.21 and 17.23 of Aliprantis and Border (2006), respectively. Property (4) 
is Theorem 4.1 (c) of Hess (2002). □ 

Lemma 3. 1. A correspondence \P from a measurable space (S,S) into a topo¬ 

logical space X is weakly measurable if and only if its closure correspondence 
\P is weakly measurable, where for each s £ S, $(s) = T(s) an d 'P(s) the 
closure of the set 'P(s) in X. 

2. For a sequence {'I'm} of correspondences from a measurable space (S,S) 
into a Polish space, the union correspondence \P(s) = U m >i^ / m('S) is weakly 
measurable if each is weakly measurable. If each is weakly measurable 
and compact valued, then the intersection correspondence <P(s) = fl m >i$ m (s) 
is weakly measurable. 

3. A weakly measurable, nonempty and closed valued correspondence from a 
measurable space into a Polish space admits a measurable selection. 

4■ A correspondence with closed graph between compact metric spaces is mea¬ 
surable. 

5. A nonempty and compact valued correspondence T from a measurable space 
( S,S) into a Polish space is weakly measurable if and only if there exists 
a sequence {if■ ■ ■} °f measurable selections of T such that \P(s) = 
(^i(s), ip 2 (s), ■ ■ ■} for each s € S. 

6. The image of a compact set under a compact valued upper hemicontinuous 
correspondence is compact. 21 If the domain is compact, then the graph of a 
compact valued upper hemicontinuous correspondence is compact. 

7. The intersection of a correspondence with closed graph and an upper hemi¬ 
continuous compact valued correspondence is upper hemicontinuous. 

8. If the correspondence 'P: S —> R l is compact valued and upper hemi¬ 
continuous, then the convex hull of \P is also compact valued and upper 
hemicontinuous. 

Proof. Properties (l)-(7) are Lemmas 18.3 and 18.4, Theorems 18.13 and 18.20, 
Corollary 18.15, Lemma 17.8 and Theorem 17.25 in Aliprantis and Border (2006), 
respectively. Property 8 is Proposition 6 in Hildenbrand (1974, p.26). □ 

Lemma 4. 1. Lusin’s Theorem: Suppose that S is a Borel subset of a Polish 

space, A is a Borel probability measure on S and S is the completion of B{S) 

21 Given a correspondence F: X —>■ P and a subset A of X, the image of A under F is defined to be 
the set U X £aF(x). 
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under A. Let X be a Polish space. If f is an S-measurable mapping from S to 
X, then for any e > 0, there exists a compact subset S\ C S with A(5\5i) < e 
such that the restriction of f to S\ is continuous. 

2. Let (5,5) be a measurable space, X a Polish space, and Y a separable Banach 
space. Let \h: 5 x X —>• Y be an S ® B{X)-measurable, nonempty, convex 
and compact valued correspondence which is sectionally continuous on X. 
Then there exists an S <8>B(X)-measurable selection if of \P that is sectionally 
continuous on X. 

3. Let (5, S, A) be a finite measure space, X a Polish space, and Y a locally 
convex linear topological space. Let F: S —>• X be a closed-valued corre¬ 
spondence such that Gr(F) £ S <S>B(X), and f: Gr(F) —»• Y a measurable 
function which is sectionally continuous in X. Then there exists a measurable 
function f':SxX —> Y such that (1) f is sectionally continuous in 
X, (2) for X-almost all s £ 5, f(s,x) = f(s,x ) for all x £ F(s) and 
f(s,X)Ccof(s,F(s )). 22 

Proof. Lusin’s theorem is Theorem 7.1.13 in Bogachev (2007). Properties (2) and 
(3) are Theorem 1 and Theorem 2.7 in Fierro, Martinez, and Morales (2006) and 
Brown and Schreiber (1989), respectively. □ 

The following lemma presents the convexity, compactness and continuity 
properties of integrals of correspondences 

Lemma 5. Let (5, S, A) be an atomless probability space, X a Polish space, and 
F a correspondence from S to . Denote 


L 


F(s)X(ds) = < / /(s)A(ds): / is an integrable selection of F on S 


1. If F is measurable, nonempty and closed valued, and X-integrably bounded by 
some integrable function if: S —>■ M_|_ in the sense that for X-almost all s £ S, 
||y|| < if(s) for any y £ F(s), then f s F(s)X(ds) is nonempty, convex and 
compact, and 

[ F(s)X(ds) = f coF(s)X(ds). 

Js Js 

2. If G is a measurable, nonempty and closed valued correspondence from S x 
X —>• R 1 such that (1) G(s,-) is upper (resp. lower) hemicontinuous on X 
for all s £ S, and (2) G is X-integrably bounded by some integrable function 
if:S —>• M + in the sense that for X-almost all s £ S, ||y|| < i)>(s) for any x £ X 
and y € G(s,x), then f s G(s, x)X(ds) is upper (resp. lower) hemicontinuous 
on X. 

22 For any set A in a linear topological space, coA denotes the convex hull of A. 
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Proof. See Theorems 2, 3 and 4, Propositions 7 and 8, and Problem 6 in 
Section D.II.4 of Hildenbrand (1974). □ 

The following result proves a measurable version of Lyapunov’s theorem, which 
is taken from Mertens (2003). Let (£, 5) and (X, X) be measurable spaces. A 
transition probability from S to X is a mapping / from S to the space M(X) of 
probability measures on (X,X) such that f(B |-) : s —>• f(B\s) is 5-measurable for 
each B € X. 

Lemma 6. Let /(-|s) be a transition probability from a measurable space (S,S) 
to another measurable space (X,X) (X is separable J . 23 Let Q be a measurable, 
nonempty and compact valued correspondence from S x X to M , which is f- 
integrable in the sense that for any measurable selection q of Q, q(-,s) is /(-|s)- 
absolutely integrable for any s € S. Let f Q df be the correspondence from S to 
subsets ofM 1 defined by 


M(s) = / Qdf ) (s) = 


q(s,x)f(dx\s): q is a measurable selection of Q 


lx 


Denote the graph of M by J. Let J be the restriction of the product cr-algebra 
S (g> B(R l ) to J. 

Then 

1. M is a measurable, nonempty and compact valued correspondence; 

2. there exists a measurable, M 1 -valued function g on (X x J, X <g> J) such that 
g(x, e, s ) € Q(x, s) and e = f x g(x, e, s)f(dxfs). 

Suppose that (Si,<Si) is a measurable space, S 2 is a Polish space endowed with 
the Borel c-algebra, and S = S\ x S 2 which is endowed with the product a-algebra 
S. Let D be an 5-measurable subset of S such that D(si) is compact for any 
si £ S\. The a-algebra V is the restriction of S on D. Let X be a Polish space, 
and A a D-measurable, nonempty and closed valued correspondence from D to X 
which is sectionally continuous on £ 2 - The following lemma considers the property 
of upper hemicontinuity for the correspondence M as defined in Lemma 6. 

Lemma 7. Let /(-|s) be a transition probability from (D,T>) to M(X) such that 
f(A(s)\s) = 1 for any s € D, which is sectionally continuous on £ 2 - Let G be a 
bounded, measurable, nonempty, convex and compact valued correspondence from 
Gr(A) to M. 1 , which is sectionally upper hemicontinuous on £2 x X. Let f Gdf be 
the correspondence from D to subsets of M. 1 defined by 


M(s) = ( Gdf ) (s) = < / g(s,x)f(dx\s): g is a measurable selection of G> . 


lx 


23 


A cr-algebra is said to be separable if it is generated by a countable collection of sets. 
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Then M is S-measurable, nonempty and compact valued, and sectionally upper 
hemicontinuous on S 2 - 

Proof. Define a correspondence G: S x X —>• M. 1 as 

g ={ a(s ’ x) ’ if(s ’ l)eGr(A); 

I {0}, otherwise. 

Then M(s) = Gdf^j ( s ) = (/ Gd/) (s). The measurability, nonemptiness and 
compactness follows from Lemma 6. Given s\ £ S± such that (1) D(s i) ^ 0, 
(2) f(s i,-) and G(si,-,-) is upper hemicontinuous. The upper hemicontinuity 
of M(si,-) follows from Lemma 2 in Simon and Zarne (1990) and Lemma 4 in 
Reny and Robson (2002). □ 

Now we state some properties for transition correspondences. 

Lemma 8. Suppose that Y and Z are Polish spaces. Let G be a measurable, 
nonempty, convex and compact valued correspondence from Y to M(Z). Define a 
correspondence G' from M(Y) to M(Z) as 


G'(v ) = ij g(y)v(dy): g is a Borel measurable selection of G 

1. The correspondence G' is measurable, nonempty, convex and compact valued. 

2. The correspondence G is upper hemicontinuous if and only if G' is upper 
hemicontinuous. In addition, if G is continuous, then G' is continuous. 

Proof. (1) is Lemma 19.29 of Aliprantis and Border (2006). By Theorem 19.30 
therein, G is upper hemicontinuous if and only if G' is upper hemicontinuous. We 
need to show that G' is lower hemicontinuous if G is lower hemicontinuous. 

Let Z be endowed with a totally bounded metric, and U(Z) the space of 
bounded, real-valued and uniformly continuous functions on Z endowed with the 
supremum norm. Pick a countable set {fm}m> l Q U(Z) such that {f m } is dense 
in the unit ball of U ( Z). The weak* topology of A4(Z) is metrizable by the metric 
d z , where 



laj ^ 

m= 1 

for each pair of £ M.(Z). 

Suppose that {vj}j >o is a sequence in M(Y) such that Vj —> uq as j —> oo. 
Pick an arbitrary point € G'(uq). By the definition of G', there exists a Borel 
measurable selection g of G such that go = j Y g(y)vo(dy). 


/ fm(z)pi(dz) - / f m (z)g 2 (dz) 
J Z JZ 
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For each k > 1, by Lemma 4 (Lusin’s theorem), there exists a compact subset 
D k C Y such that g is continuous on D k and vq{Y \ D k ) < Define a 

correspondence G k : Y —>• M(X') as follows: 

= ( {s<2,)} ’ y€Dkt 
(G(y), y £Y \ D k . 

Then G k is nonempty, convex and compact valued, and lower hemicontinuous. 
By Theorem 3.22 in Aliprantis and Border (2006), Y is paracompact. Then by 
Michael’s selection theorem (see Theorem 17.66 in Aliprantis and Border (2006)), 
it has a continuous selection g k . 

For each k, since Vj isq and g k is continuous, f y g k (y)v , j(dy) —> f y g k (y)no(dy) 
in the sense that for any m > 1, 


fm(z)g k (dz\y)uj(dy) 


fm(z)gk(dz\y)v 0 (dy). 


IYJZ JYJZ 

Thus, there exists a point Uj k such that {j k } is an increasing sequence and 

d z g k {y)vj k (dy)’ g k {y)Mdy)^J < 

In addition, since g k coincides with g on D k and vq(Y \ D k ) < 

2 


Thus, 


d z ( ^ 9k(y)Mdy),J^g(y)Mdy)J < 3fc . 


d z ( l^9k(y)vj k (dy), J^g(y)vo(dy)j 


Let m k = J Y g k (y)u 3k (dy) for each k. Then Hj k € G'(u jk ) and y 3k ->■ y 0 as k ->• oo. 
By Lemma 2, G' is lower hemicontinuous. □ 

Lemma 9. Let X, Y and Z be Polish spaces, and G a measurable, nonempty and 
compact valued correspondence from X to A4(Y). Suppose that F is a measurable, 
nonempty, convex and compact valued correspondence from X xY toM(Z). Define 
a correspondence II from X to A4(Y x Z) as follows: 

n(x) = {g(x) o f(x): g is a Borel measurable selection of G, 
f is a Borel measurable selection of F}. 

1. If F is sectionally continuous on Y, then II is a measurable, nonempty and 
compact valued correspondence. 
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2. If there exists a function g from, X to M.(Y ) such that G(x) = {g(x)} for any 
x £ X, then II is a measurable, nonempty and compact valued correspondence. 

3. If both G and F are continuous correspondences, then II is a nonempty and 
compact valued, and continuous correspondence , 24 

4■ If G(x) = {A} for some fixed Borel probability measure A £ Ai(Y) and F is 
sectionally continuous on X, then II is a continuous, nonempty and compact 
valued correspondence. 

Proof. (1) Define three correspondences F: X xY —> M.(Y x Z), F \ A4(X xF) 4 
M(Y x Z) and F: X x M(Y) —» M(Y x Z ) as follows: 

F(x,y) = {S y <S) [i £ F(x,y)}, 

F(t) = \ / /(x, y)r(d(x, y)): f is a Borel measurable selection of F 

[JxxY 

F{x,n) = F(5 X <g> pi). 

Since F is measurable, nonempty, convex and compact valued, F is measurable, 
nonempty, convex and compact valued. By Lemma 8, the correspondence F is 
measurable, nonempty, convex and compact valued, and F(x,-) is continuous on 
M(Y) for any x € X. 

Since G is measurable and compact valued, there exists a sequence of Borel 
measurable selections {gk}k >l of G such that G(x) = {g\ (x), g^ (a?),...} for any 
x £ X by Lemma 3 (5). For each k > 1, define a correspondence II fc from X to 
M(Y x Z) by letting n fc (x) = F(x,gk(x)) = F(x®gk(x)). Then n fe is measurable, 
nonempty, convex and compact valued. 

Fix any x € X. It is clear that II(a;) = F(x, G(x)) is a nonempty valued. Since 
G{x) is compact, and F(x,-) is compact valued and continuous, II(x) is compact 
by Lemma 3. Thus, {II 1 (x), II 2 (x),...} C II(x). 

Fix any x € X and t € n(x). There exists a point u £ G(x) such that 
t £ F(x,v). Since {gk(%)}k> l is dense in G(x), it has a subsequence {gkm(x)} 
such that g km {x) — > v. As F(x,-) is continuous, F(x,gk m (x)) —> F(x,u). That is, 

r £ {F(x,g 1 (x)),F(x,g 2 (x)),...} = {^(x), n 2 (x),...}. 

Therefore, {II 1 (x), II 2 (x),...} = II(x) for any x £ X. Lemma 3 (5) implies that II 
is measurable. 



24 In Lemma 29 of Harris, Reny and Robson (1995), they showed that n is upper hemicontinuous if 
G and F are both upper hemicontinuous. 
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(2) As in (1), the correspondence F is measurable, nonempty, convex and 
compact valued. If G is a measurable function, then II(x) = F(x <g> G(x)), which 
is measurable, nonempty and compact valued. 

(3) We continue to work with the two correspondences F: X xY Ad{Y x Z) 
and F: M.(XxY ) —>• M.(Y x Z) as in Part (1). By the condition on F, it is obvious 
that the correspondence F is continuous, nonempty, convex and compact valued. 
Lemma 8 implies the properties for the correspondence F. Define a correspondence 
G: X —>• M(X x Y) as G(x) = S x <S> G(x). Since G and F are both nonempty 
valued, II(x) = F(G(x)) is nonempty. As G is compact valued and F is continuous, 
II is compact valued by Lemma 3. As G and F are both continuous, II is continuous 
by Lemma 2 (7). 

(4) The lower hemicontinuity is from Proposition 4.8 in Sun (1997). The 

nonemptiness and compactness follow from Corollary 18.37 of Aliprantis and Border 
(2006) while the upper hemicontinuity follows from the compactness property 
easily. □ 

The following result presents a variant of Lemma 6 in terms of transition 
correspondences. 

Lemma 10. Let X and Y be Polish spaces, and Z a compact subset of 
Let G be a measurable, nonempty and compact valued correspondence from X to 
M.(Y). Suppose that F is a measurable, nonempty, convex and compact valued 
correspondence from X x Y to Z. Define a correspondence II from X to Z as 
follows: 

n(x) = { / f(x,y)g(dy\x): g is a Borel measurable selection of G, 

Jy 

f is a Borel measurable selection of F}. 

If F is sectionally continuous on Y, then 

1. the correspondence F: X x M.{Y) —>• Z as F(x,v) = f y F(x, y)n(dy) is 
sectionally continuous on M.(Y); and 

2 . n is a measurable, nonempty and compact valued correspondence. 

3. If F and G are both continuous, then II is continuous. 

Proof. The upper hemicontinuity of F(x, •) follows from Lemma 7, and the proof 
for the lower hemicontinuity of F{x , ■) is similar to that of Lemma 8. The proof of 
(2) and (3) follows a similar argument as in the proof of Lemma 9. □ 
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Lemma 11. Let S, X and Y be Polish spaces endowed with the Borel a-algebras, 
and A a Borel probability measure on S. Denote S as the completion of the Borel 
a-algebra B(S) of S under the probability measure A. Suppose that D is a B(S) <g> 
B(Y)-measurable subset of S x Y, where D(s) is nonempty and compact for all 
s G S. Let A be a nonempty and compact valued correspondence from D to X, 
which is sectionally continuous on Y and has a B(S x Y X X)-measurable graph. 
Then 

(i) A{s) = Gr(A(s, •)) is an S-measurable mapping from S to the set of nonempty 
and compact subsets KyxX of Y x X; 

(ii) there exist countably many disjoint compact subsets {5 m } m >i of S such that 
(1) A(U m >i5 m ) = 1, and (2) for eachm > 1, D m = Dn(S m xY) is compact, 
and A is nonempty and compact valued, and continuous on each D m . 

Proof, (i) A(s, •) is continuous and D(s) is compact, Gr(A(s, •)) C YxX is compact 
by Lemma 3. Thus, A is nonempty and compact valued. Since A has a measurable 
graph, A is an 5-measurable mapping from S to the set of nonempty and compact 
subsets ICyxX of Y x X by Lemma 2 (4). 

(ii) Define a correspondence D from S to Y such that D(s) = {y €Y: (s,y) G 
D}. Then D is nonempty and compact valued. As in (i), D is 5-measurable. 
By Lemma 4 (Lusin’s Theorem), there exists a compact subset Si C S such that 
A(S \ Si) < D and A are continuous functions on Si. By Lemma 2 (3), D and 
A are continuous correspondences on Si. Let D\ = {(s,y) G D: s G S\,y G D(s)}. 
Since Si is compact and D is continuous, D\ is compact (see Lemma 3 (6)). 

Following the same procedure, for any m > 1, there exists a compact subset 
S m C S such that (1) S m r\(Ui<k<m-iSk) = 0 and D m = Dn(S m x Y) is compact, 
(2) A(S m ) > 0 and A (S \ (Ui<fc< m S m )) < and (3) A is nonempty and compact 
valued, and continuous on D m . This completes the proof. □ 

Lemma 12. Let S and X be Polish spaces, and A a Borel probability measure on 
S. Suppose that {Sfc}fc>i is a sequence of disjoint compact subsets of S such that 
A(Ufc>iSfc) = 1. For each k, define a probability measure on Sk as Xk(D) = jnQ 
for any measurable subset D C S/ f . Let {v m }m>o be a sequence of transition 
probabilities from S to Ai(X), and r m = A o v m for any m > 0. Then r m weakly 
converges to To if and only if A k o v m weakly converges to A k o for each k > 1. 

Proof. First, we assume that r m weakly converges to To- For any closed subset 
E C SkxX , we have lirrisup m ^ oc T m (E ) < tq{E). That is, lirnsup m _ ) . 00 Ao v m (E) < 
Aot'o(F). For any k, limsup m _ ) . 0O A o v m {E) < A(g fc ) ^ ° u o(E), which implies 
that limsup m _ >00 A k o v m {E) < A k o vq(E). Thus, A k o n m weakly converges to 
A k o f° r each k > 1. 
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Second, we consider the case that Afc o v m weakly converges to Afe o uq for each 
k > 1. For any closed subset Fi C SxX, let Fife = En(SkXX) for each k > 1. Then 
{Fife} are disjoint closed subsets and limsup m _ >00 Afc ov m (Ek) < X^ouq (Fife). Since 
Xk o Vm{E') = w^yA o v m (E f ) for any k, m and measurable subset E' C Sk x A', 
we have that limsup m _ ) . (X) A o i/ m (Fifc) < Aoi/ 0 (Ffc). Thus, 



«%w<E A o i/ 0 (F; fe ) 

fc>i 


A o vq(E). 


Since the limit superior is subadditive, we have 


lim sup Xou m (Fife) > lim sup 'S~\ X o v m (Fife) = lim sup A o v m {E). 

.. m—>oo m—>oo . . . m—>• oo 

/c>l «>1 

Therefore, limsup m _ > . 0O A o v m {E) < A o i/q (Fi), which implies that r m weakly 
converges to To- □ 

Lemma 13. Suppose that X, Y and S are Polish spaces and Z is a compact metric 
space. Let X be a Borel probability measure on S, and A a nonempty and compact 
valued correspondence from Z x S to X which is sectionally upper hemicontinuous 
on Z and has a B(Z x S x X)-measurable graph. Let G be a nonempty and compact 
valued, continuous correspondence from Z to A4(X x S). We assume that for any 
z £ Z and r G G(z), the marginal of t on S is X and r(Gr(A(z, •))) = 1. Let F be a 
measurable, nonempty, convex and compact valued correspondence from Gr(A) —> 
A4(Y) such that F is sectionally continuous on Z x X. Define a correspondence 
II from Z to A4(X x S x Y) by letting 


II (z) = {g(z) o f(z, ■): g is a Borel measurable selection of G , 
f is a Borel measurable selection of F}. 


Then the correspondence II is nonempty and compact valued, and continuous. 

Proof. Let S be the completion of B(S) under the probability measure A. By 
Lemma 11, A(s) = Gr(A(s, •)) can be viewed as an 5-measurable mapping from 
S to the set of nonempty and compact subsets ICzxX of Z x X. For any s £ S, 
the correspondence F s = F(-,s) is continuous on AL(s). By Lemma 4, there exists 
a measurable, nonempty and compact valued correspondence F from Z x X x S 
to J\A(Y ) and a Borel measurable subset S' of S with A (S') = 1 such that for each 
s G S', F s is continuous on Z x X, and the restriction of F s to A(s) is F s . 

By Lemma 4 (Lusin’s theorem), there exists a compact subset Si C S' such 
that A is continuous on Si and A(Si) > Let K\ = A(Si). Then K\ C Z x X is 
compact. 
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Let C(Ki, ICj^ry)) be the space of continuous functions from K\ to 
where Fm(y) is the set of nonempty and compact subsets of M(Y). Suppose 
that the restriction of S on S± is <Si. Let F\ be the restriction of F to K\ x S\. 
Then F\ can be viewed as an <Si-measurable function from S\ to C(Ki,K.m(y)) 
(see Theorem 4.55 in Aliprantis and Border (2006)). Again by Lemma 4 (Lusin’s 
theorem), there exists a compact subset of Si, say itself, such that A(S'i) > \ 
and F\ is continuous on Si. As a result, F\ is a continuous correspondence on 
Gr(A) (~l (Si x Z x X ), so is F. Let Ai be a probability measure on Si such that 
Ai(D) = for any measurable subset D C Si. 

Fix any z € Z and r G G(z). By the definition of G , there exists a transition 
probability v from S to X such that A o v = r. Define a correspondence G*i from 
Z to A4(X x S) as follows: for any z G Z, Gi(z) is the set of all ti = Ai o v such 
that r = A o v G G(z). It can be easily checked that G i is also a nonempty and 
compact valued, and continuous correspondence. Let 

IIi(z) = {ri o f(z, •): n = Ai ov G Gi(z), 

f is a Borel measurable selection of F}. 

By Lemma 9, ILi is nonempty and compact valued, and continuous. Furthermore, 
it is easy to see that for any z, Lli(z) coincides with the set 

{(Ai ov) o f(z, ■): A o v G G(z), f is a Borel measurable selection of F}. 

Repeat this procedure, one can find a sequence of compact subsets {St} such 
that (1) for any t > 1, St C S', St H (Si U ... St_i) = 0 and A(Si U ... U St) > 

(2) F is continuous on Gr(A) n (St x Z x X), X t is a probability measure on St such 
that A t(D) = x(s,\ f° r any measurable subset D C St, and (3) the correspondence 

Llt(,z) = {(A t ov)o f(z, ■): A o v G G(z), 

f is a Borel measurable selection of F 1 }. 

is nonempty and compact valued, and continuous. 

Pick a sequence { z k }, {v k } and {f k } such that (Xov k )of k (z k , ■) G II(^), z k -G z 0 
and (A o v k ) o f k (z k , ■) weakly converges to some k. It is easy to see that (At o v k ) o 
f k (z k ,-) G Llt^fc) for each t. As IR is compact valued and continuous, it has a 
subsequence, say itself, such that z k converges to some zo G Z and (XiOv k )of k (z k , ■) 
weakly converges to some (Aio^ 1 ) o/ 1 (z 0 , ■) G IIi(zo)- Repeat this procedure, one 
can get a sequence of {n m } and f m . Let /x(s) = /i m (s) and f(zo, s, x) = f m (zo, s, x) 
for any x G A(zq,s) when s G S m . By Lemma 12, (A o /jl) o f(zo, •) = k, which 
implies that II is upper hemicontinuous. 
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Similarly, the compactness and lower hemicontinuity of II follow from the 
compactness and lower hemicontinuity of II^ for each t. □ 

Lemma 14. Let S and X be Polish spaces, and A a measurable, nonempty and 
compact valued correspondence from S to X. Suppose that X is a Borel probability 
measure on S and {^nji^n^oo is a sequence of transition probabilities from S to 
M(X) such that z/ n (A(s)|s) = 1 for each s and n. For each n > 1, let r n = Ao v n . 
Assume that the sequence {r n } of Borel probability measures on S x X converges 
weakly to a Borel probability measure t 00 on S x X. Let {<?n}i<n<oo i> e a sequence 
of functions satisfying the following three properties. 

1. For each n between 1 and oo, g n : S x X —> M + is measurable and sectionally 
continuous on X. 

2. For any s € S and any sequence x n —> Xoo in X, g n (s,x n ) —> goo(s,Xoo) as 
n —> oo. 

3. The sequence {g n }i<n<oo is integrably bounded in the sense that there exists 
a X-integrable function ip: S —> M + such that for any n, s and x, g n (s,x) < 
V>(s). 

Then we have 

/ g n (s,x)T n (d(s,x)) ->• / goo{s, x)r 00 (d(s, x)). 

JsxX JsxX 

Proof. By Theorem 2.1.3 in Castaing, De Fitte and Valadier (2004), for any 
integrably bounded function g: S x A" —M + which is sectionally continuous on 
X, we have 

( 2 ) 


/ g{s,x)T n (d(s,x))^ g(s, x)roo(d(s, x)). 

JSxX JSxX 


Let {y n }i<n<oo be a sequence such that y n = L and y^ = 0. Then y n y^. 
Define a mapping g from SxXx {y i,..., y Q o} such that g(s, x, y n ) = g n (s, x). Then 
g is measurable in S and continuous in X x {y \,..., yoo}- Define a correspondence 
G from S to X x {y\, ..., yoo} x R + such that 

G(s) = {(x, y n , c): c € g(s, x, y n ),x € A(s), 1 < n < oo} . 

For any s, 2l(s) x {yi,--.,yoo} is compact and g(s, •, •) is continuous. By 
Lemma 3 (6), G(s) is compact. By Lemma 2 (2), G can be viewed as a measurable 
mapping from S to the space of nonempty compact subsets of X x {y±, ..., y^} X 
R_l_. Similarly, A can be viewed as a measurable mapping from S to the space of 
nonempty compact subsets of X. 
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Fix an arbitrary e > 0. By Lemma 4 (Lusin’s theorem), there exists a compact 
subset Si C S such that A and G are continuous on Si and X(S\Si) < e. Without 
loss of generality, we can assume that A (S' \ Si) is sufficiently small such that 
f s \ s i tp(s)X(ds) < |. Thus, for any n, 

[ ip(s)Tn(d(s,x)) = [ t/;(s)v n (X)X(ds) < 

J(S\S i)xX J(S\S i) b 

By Lemma 3 (6), the set E = {(s,x): s € Si,x € At(s)} is compact. Since G 
is continuous on Si, g is continuous on E x {yi ,..., j/oo}- Since E x {yi ,..., y^} 
is compact, g is uniformly continuous on E x {y\ ,... ,2/oo}- Thus, there exists a 
positive integer N\ > 0 such that for any n > N \, \g n (s, x ) — goo(s, x)| < | for any 
(s, x ) € E. 

By Equation (2), there exists a positive integer N 2 such that for any n > N 2 , 


/ goo(s,x)T n (d(s,x)) - g 00 (s,x)r 00 (d(s,x)) 

JSxX JSxX 

Let No = max{iVi,-A^}- For any n> No, 

/ g n (s,x)T n {d(s,x)) - \ goo(s, x)T oa (d(s, x)) 
JSxX JSxX 


e 

< 3‘ 


< 

+ 

< 

+ 

+ 

< 

+ 


' SxX 


g n (s,x)T n (d(s,x)) - / goo(s,x)T n (d(s,x)) 


I SxX 


/ goo(s,x)T n (d(s,x)) - goo(s, x)r 00 (d(s, x)) 

JSxX JSxX 

/ g n (s,x)T n (d(s,x))- 5 00 (s,x)r n (d(s,a;)) 

Js ixi JSix:x 

/ g n (s,x)T n (d(s,x))- g' 00 (s,a;)r n (d(s,a;)) 

J(S\Si)xX J(S\Si)xX 


/ goo(s,x)T n (d(s,x)) - goois, x)r oc (d(s,x)) 

/ |5n(s,®)-ffoo(s,x)|r n (d(s,x))+ 2- / 

/ E J(i 

/ 5oo(s,^)Tn(d( s > a:: )) 

J SxX 


(S\S i)xX 
5oo(s,a;)'roo(d(s,a:)) 


^(s)r„(d(s,a;)) 


I SxX 


e e e 

< - + 2 -t- - 

3 6 3 

= e. 


This completes the proof. □ 

The following result is Lemma 6 of Reny and Robson (2002). 
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Lemma 15. Suppose that H and X are compact metric spaces. Let P: H x 
X —>• K n be a nonempty valued and upper hemicontinuous correspondence, and 
the mappings f:H—> M(X) and p: H — > A(X) be measurable. In addition, 
suppose that p(-\h) = p(h,-) o f(-\h) such that p(h,-) is a measurable selection of 
P(h,-). Then there exists a jointly Borel measurable selection g of P such that 
p(-\ h) = g(h, ■) ° f(-\h); that is, g(h,x ) =p(h,x ) for f(-\h)-almost all x. 

5.2 Discontinuous games with endogenous stochastic 
sharing rules 

Simon and Zame (1990) proved the existence of a Nash equilibrium in discon¬ 
tinuous games with endogenous sharing rules. In particular, they considered a 
static game with a payoff correspondence P that is bounded, nonempty, convex 
and compact valued, and upper hemicontinuous. They showed that there exists a 
Borel measurable selection p of the payoff correspondence, namely the endogenous 
sharing rule, and a mixed strategy profile a such that a is a Nash equilibrium when 
players take p as the payoff function. 

In this subsection, we shall consider discontinuous games with endogenous 
stochastic sharing rules. That is, we allow the payoff correspondence to depend on 
some state variable in a measurable way as follows: 

1. let S be a Borel subset of a Polish space, Y a Polish space, and A a Borel 
probability measure on S'; 

2. D is a B(S) <8> i3(T)-measurable subset of S x Y, where D(s) is compact for 
all s £ S and A ({s £ S: D(s) / 0}) > 0; 

3. X = Ui<i< n Xi, where each X, is a Polish space; 

4. for each i, Ai is a measurable, nonempty and compact valued correspondence 
from D to Xj , which is sectionally continuous on Y ; 

5. A = rii<i<n A: and E = Gr(A); 

6. P is a bounded, measurable, nonempty, convex and compact valued corre¬ 
spondence from E to M n which is essentially sectionally upper hemicontinuous 
on Y x X. 

A stochastic sharing rule at (s, y) £ D is a Borel measurable selection of the 
correspondence P(s,y, •); i.e., a Borel measurable function p: A(s,y ) — > such 
that p(x) £ P(s,y,x ) for all x £ A(s,y). Given (s,y) £ D, P(s,y , •) represents the 
set of all possible payoff profiles, and a sharing rule p is a particular choice of the 
payoff profile. 

Now we shall prove the following proposition. 
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Proposition 4. There exists a B{D)-measurable, nonempty and compact valued 
correspondence from D to M n x M(X) x A(X) such that 4> is essentially 
sectionally upper hemicontinuous on Y, and for X-almost all s € S with D(s ) ^ 0 
and y £ D(s), d>(s,y) is the set of points (v,a,p) that 

1. v = f Y p(s, y, x)a(dx) such that p(s,y,-) is a Borel measurable selection of 

P(s,y,-); 25 

2. a £ ®i & iM{Ai(s,y)) is a Nash equilibrium in the subgame ( s,y ) with payoff 
p(s,y, •) and action space Ai(s,y) for each player i; 

3. n = p(s, y, •) o a. 26 

In addition, denote the restriction of 4> on the first component W 1 as <h|Rn, which 
is a correspondence from D to M n . Then $|Rn is bounded, measurable, nonempty 
and compact valued, and essentially sectionally upper hemicontinuous on Y. 

If D is a closed subset, P is upper hemicontinuous on E and Ai is continuous 
on D for each i £ /, then Proposition 4 is reduced to be the following lemma (see 
Simon and Zame (1990) and Reny and Robson (2002, Lemma 4)). 

Lemma 16. Assume that D is a closed subset, P is upper hemicontinuous on E 
and Ai is continuous on D for each i £ I. Consider the correspondence 4>: D —> 
x M(X) x A(X) defined as follows: (v,a,y) € 4>(s,y) if 

1. v = f Y p(s, y, x)a(dx) such that p(s,y,-) is a Borel measurable selection of 
P(s,y,-); 

2. a £ <S>ie/A4(Ai(s,y )) is a Nash equilibrium in the subgame ( s,y ) with payoff 
p(s,y, •) and action space Ai(s,y) for each player i; 

3. p = p(s, y, ■) o a. 

Then is nonempty and compact valued, and upper hemicontinuous on D. 

We shall now prove Proposition 4. 

Proof of Proposition f. There exists a Borel subset S C S with A (S) = 1 such that 
D(s) 0 for each s £ S, and P is sectionally upper hemicontinuous on Y when it 
is restricted on D D (S x Y). Without loss of generality, we assume that S = S. 

Suppose that S is the completion of B(S) under the probability measure A. 

Let V and £ be the restrictions of S ® B(Y) and S <S> B(Y) (g> B(X) on D and E, 
respectively. 

Define a correspondence D from S to Y such that D(s) = {y & Y: (s,y ) £ D}. 

Then D is nonempty and compact valued. By Lemma 2 (4), D is 5-measurable. 

25 Note that we require p(s, y, •) to be measurable for each (s, y), but p may not be jointly measurable. 
26 Tlre finite measure p = p(s, y, ■) o a if y(B) = f B p(s, y , a;)a(dx) for any Borel subset B Cl. 
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Since D(s) is compact and A(s, •) is upper hemicontinuous for any s G P, E(s ) 
is compact by Lemma 3 (6). Define a correspondence T from P to Y x X x R” 
as r(s) = Gr(P(s, •, •)). For all s, P(s, ■, •) is bounded, upper hemicontinuous and 
compact valued on E(s), hence it has a compact graph. As a result, F is compact 
valued. By Lemma 2 (1), P has an S <8) B(Y x X x R n )-measurable graph. Since 
Gr(r) = Gr(P), Gr(r) is S®B(Y x X x R n )-measurable. Due to Lemma 2 (4), the 
correspondence T is iS-measurable. We can view T as a function from S into the 
space 1C of nonempty compact subsets of Y x X x R”. By Lemma 1, 1C is a Polish 
space endowed with the Hausdorff metric topology. Then by Lemma 2 (2), T is 
an B-measurable function from S to 1C. One can also define a correspondence A,; 
from P to Y x X as Aj(s) = Gr(A,(s, •)). It is easy to show that A, can be viewed 
as an 5-nreasurable function from P to the space of nonempty compact subsets 
of Y x A, which is endowed with the Hausdorff metric topology. By a similar 
argument, P can be viewed as an P-measurable function from P to the space of 
nonempty compact subsets of Y. 

By Lemma 4 (Lusin’s Theorem), there exists a compact subset Pi C S such 
that A(P \ S\) < T, P and {Aj} i <i< n are continuous functions on Si. By 
Lemma 2 (3), T, D and Aj are continuous correspondences on Pi. Let D\ = 
{(s,y) € D: s € S\,y € D(s)}. Since Pi is compact and D is continuous, D\ is 
compact (see Lemma 3 (6)). Similarly, Pi = Pn(Pi xYxX) is also compact. Thus, 
P is an upper hemicontinuous correspondence on Pi. Define a correspondence 4>i 
from Pi to R n x JCi(X) x A(X) as in Lemma 16, then it is nonempty and compact 
valued, and upper hemicontinuous on Pi. 

Following the same procedure, for any m > 1, there exists a compact subset 
P m C P such that (1) P m (~l (Ui< fe < m _iP fe ) = 0 and D m = D n (P m x Y) is 
compact, (2) A(P m ) > 0 and A (P \ (Ui<jt< m P m )) < and (3) there is a 
nonempty and compact valued, upper hemicontinuous correspondence 4> m from 
D m to R n x A4(X) x A(X), which satisfies conditions (l)-(3) in Lemma 16. Thus, 
we have countably many disjoint sets {P m }m>i such that (1) A(U m >iP m ) = 1, 
(2) <l> m is nonempty and compact valued, and upper hemicontinuous on each D m , 
m > 1 . 

Since A* is a B(S) ® B(T)-measurable, nonempty and compact valued corre¬ 
spondence, it has a Borel measurable selection a, by Lemma 3 (3). Fix a Borel 
measurable selection p of P (such a selection exists also due to Lemma 3 (3)). 
Define a mapping (no, ao> Bo) from P to W 1 x Ai(X) x A(A) such that (1) ctj(s, y ) = 
S ai (s,y) and a 0 (s,y) = <g y); (2) v 0 (s,y) = p(s,y,ai(s,y).... ,a n (s,y)) 
and (3) Ho(s,y ) = p(s,y,-) ° « 0 . Let P 0 = P \ (U m >iP m ) and $o(s,y) = 
{(vo(s,y),a 0 (s,y),ijLo(s,y))} for (s,y) G P 0 . Then, 4> 0 is B(S) <8>B(y)-measurable, 
nonempty and compact valued. 
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Let 4>(s,y) = Q m (s,y) if (s,y) G D m for some m > 0. Then, $(s,y) satisfies 
conditions (l)-(3) if (s,y) € D m for m > 1. That is, <f> is £>(.D)-measurable, 
nonempty and compact valued, and essentially sectionally upper hemicontinuous 
on Y, and satisfies conditions (l)-(3) for A-almost all s G S. 

Then consider < L|r", which is the restriction of T on the first component M n . 
Let <3? m | R r, be the restriction of <F m on the first component M n with the domain D m 
for each m > 0. It is obvious that <f>o|R™ is measurable, nonempty and compact 
valued. For each m > 1, D m is compact and <h m is upper hemicontinuous and 
compact valued. By Lemma 3 (6), Gr(<F m ) is compact. Thus, Gr(<L m |Rn) is also 
compact. By Lemma 3 (4), <f> m |Rn is measurable. In addition, <h m |Rn is nonempty 
and compact valued, and upper hemicontinuous on D m . Notice that < h|Rn(s,y) = 
^m\R n {s,y) if (s,y) G D m for some m > 0. Thus, 4%™ is measurable, nonempty 
and compact valued, and essentially sectionally upper hemicontinuous on Y. 

The proof is complete. □ 


5.3 Proofs of Theorem 1 and Proposition 1 

5.3.1 Backward induction 

For any t > 1, suppose that the correspondence Qt+i from H t to M" is bounded, 
measurable, nonempty and compact valued, and essentially sectionally upper 
hemicontinuous on X 1 . For any ht- 1 G H t - 1 and Xt G A t {ht- 1 ), let 

P t (h t -i,x t )= / Qt+i(ht-i,xt,st)fto(ds t \ht-i) 

J s t 

= / Q t+1 (ht-i,xt,st)<pto{ht-i,st)\t{ds t ). 

J s t 

It is obvious that the correspondence Pt is measurable and nonempty valued. Since 
Qt~ i-i is bounded, Pt is bounded. For A 4 -almost all s t G S*, Qt+i(-, s*) is bounded 
and upper hemicontinuous on H t (s t ), and < pto(s t , •) is continuous on Gr(d.Q)(s t ). As 
ipto is integrably bounded, •) is also upper hemicontinuous on Gi(A t )(s t ^ 1 ) 

for A <_1 -almost all G S t ~ 1 (see Lemma 5); that is, the correspondence Pt is 
essentially sectionally upper hemicontinuous on X t . Again by Lemma 5, Pt is 
convex and compact valued since A t is an atomless probability measure. That is, 
Pt- Gr(T) ->• R n is a bounded, measurable, nonempty, convex and compact valued 
correspondence which is essentially sectionally upper hemicontinuous on X 1 . 

By Proposition 4, there exists a bounded, measurable, nonempty and compact 
valued correspondence from Ht- 1 to M n x Ai(Xt) x A (Xt) such that is 
essentially sectionally upper hemicontinuous on and for A <_1 -almost all 

h t - 1 G H t - 1 , (v,a,n) G $ t (h t - 1 ) if 
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1. v = f At ( ht 1 )Pt(ht-i,x)a(dx) such that pt(ht~ i,-) is a Borel measurable 
selection of Pt(ht~ 1 , ■); 

2. a G 1 )) is a Nash equilibrium in the subgame ht- 1 with payoff 

Pt(h t - 1 ,-) and action space ]”[*£/ 

3. /x = p t (ht- 1, •) ° «• 

Denote the restriction of <f>t on the first component as d*((5i+i), which is 
a correspondence from H t - 1 to M n . By Proposition 4, <3?(Qt+i) is bounded, 
measurable, nonempty and compact valued, and essentially sectionally upper 
hemicontinuous on i . 

5.3.2 Forward induction 

The following proposition presents the result on the step of forward induction. 

Proposition 5. For any t> 1 and any Borel measurable selection qt of ^(Qt+i), 
there exists a Borel measurable selection q t+ 1 of Qt+i and a Borel measurable 
mapping ft: H t -1 — >• ®i & iM.(X t i) such that for X^ 1 -almost all h t -i G H t - 1 , 

1- ft(ht~ i) € <S>i£iXi(Ati(ht- 1)); 

2. q t (h t - 1 ) = f At Q lt _ 1 ' ) f St qt+i{ht-i,xt,s t )fto(dst\ht-i)ft{dx t \ht-i); 

3. ft(-\ht-i) is a Nash equilibrium in the subgame ht -1 with action spaces 
A t i(ht-i),i G I and the payoff functions 

/ q t+ i{h t -i, -, s t )fto{ds t \ht-i). 

J s t 

Proof. We divide the proof into three steps. In step 1, we show that there exist 
Borel measurable mappings ft: H t ~i —> ®i & iM.[X t i) and pt '■ Ht -1 —> A(X t ) such 
that (qt, ft, Pt) is a selection of <h t . In step 2, we obtain a Borel measurable selection 
gt of P t such that for A t_1 -almost all ht -1 G H t - 1 , 

1. qt(ht-i) = J At{ht i) g t (h t -i,x)ft(dx\h t - 1 ); 

2. f t (ht- 1 ) is a Nash equilibrium in the subgame h t -i with payoff gt(h t ~ i, ■) and 
action space A t (ht-i)\ 

In step 3, we show that there exists a Borel measurable selection qt+i of Qt.+i such 
that for all h t -\ G H t -\ and Xt G A t (h t - 1 ), 

g t (h t -i,x t )= / q t+ i(ht-i,xt,s t )fto(dst\ht-i). 

Js t 

Combining Steps 1-3, the proof is complete. 
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Step 1. Let Gr($*(Q t+1 )) M{X t ) x A(X t ) be 


i,v) = {(a,//): (v,a,n) G ® t {h t - 1)}. 


Recall the construction of <f>t and the proof of Proposition 4, Ht—i can be divided 
into countably many Borel subsets such that 


1. H t -1 = U m > 0 iL™i and 


A f - 1 (u m >iproj jg t-i (gRi)) _ 


A t - 1 (proj s , t -i ’ 

and proj s t-i(i/t_i) are projections of Hff 1 and H t -\ 


where proj 5 t-i {Hfff) 
on 


2. for m > 1, H™ 1 is compact, is upper hemicontinuous on H™ l5 and Pt is 
upper hemicontinuous on 


{{h t -i,x t ): h t - 1 G H^xt G 


3. there exists a Borel measurable mapping (no, ao, Po) from H^_ x to M n x 
M{X t ) x A(X t ) such that <& t {ht- 1) = {(w 0 (fo-i), a 0 (fo-i), Mo(^-i))} for 
any G H^_ x . 

Denote the restriction of 4*4 on Hff 1 as <!>(”. For m > 1, Gr(4>™) is compact, 
and hence the correspondence '&f l (ht-i,v) = {(a,p): (v,a,p) G has 

a compact graph. For m > 1, 'P™ is measurable by Lemma 3 (4), and has a 
Borel measurable selection -0™ due to Lemma 3 (3). Define ipt{ht-i,vo{ht-i)) = 
(a 0 {h t -i), Ho{h t -i)) for h t -\ G H$_ v For (h t -i,v) G Gr{$(Q t+ i)), letift(h t -i,v) = 
ip‘t l (ht-i,v) if ht ~i G H Then ipt is a Borel measurable selection of 4q. 

Given a Borel measurable selection q t of 4>((3t+i), let 

4>t(ht-i) = {qt{ht-i),ipt{ht-i,q t {ht-i))). 

Then (f>t is a Borel measurable selection of Denote Ht -1 = U m >i Hff 1 . 

By the construction of there exists Borel measurable mappings ft: Ht -1 —>• 
®i£iM.{X t i) and fit: H t - 1 —> A(X t ) such that for all ht -1 G Ht- 1 , 

1. q t {h t - 1 ) = / J 4 t (^ t _ 1 ) Pt(ht-i j a; )/t(d3?|^-i) such that p t (h t -i,-) is a Borel 
measurable selection of Pt{h t ~ i, •); 

2. f t (ht- 1 ) G ®i£iM{Ati{h t -{)) is a Nash equilibrium in the subgame h t -\ with 
payoff pt(ht~ i, •) and action space n,e/ A ti {ht- 1); 

3. = pt{h t - 1 , ■) o 


Step 2. Since Pt is upper hemicontinuous on ht -1 G Hff 1 ,xt G 

due to Lemma 15, there exists a Borel measurable mapping such 
that (1) g m (ht-i,x t ) G P t {h t -i,x t ) for any /i t _i G and x t G A t (h t - 1 ), and 
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(2) g m (ht-i,xt) = pt(ht~i,xt) for /z(-|fo-i )-almost all xt- Fix an arbitrary Borel 
measurable selection g' of Pt. Define a Borel measurable mapping from Gr(Ai) to 
R ra as 


g{ht-i,x t ) 


g m {h t -i,x t ) if h t -1 € for m > 1 ; 

g'(ht-i,xt) otherwise. 


Then g is a Borel measurable selection of Pt- 
In a subgame ht -1 £ H t - 1 , let 


Pti(ht~ i) — {yi £ At.i(ht-i)- 


' A t (-i)(h. t - i ) 


9i(ht-i, yt, ) ft(—i) i) I ht-i) 


' At(ht- i ) 




Since g(h t -i,x t ) = p t {h t -i,x t ) for / t (-|fo_i)-almost all x t , 


J At(ht-\) J At(ht-i) 

Thus, Bfj is a measurable correspondence from Ht-i to Au(ht- 1 ). Let B^(ht- 1 ) = 
A t i(ht-i ) \ B t i{ht- 1 ) for each ht- 1 € H t - 1 - Then B^ is a measurable and closed 
valued correspondence, which has a Borel measurable graph by Lemma 2. As a 
result, also has a Borel measurable graph. As ft(ht-i) is a Nash equilibrium 
in the subgame h t -i £ H t -\ with payoff p t (h t - 1 , ■), fu(Bu(h t -i)\ht-i) = 0 . 

Denote (3i(ht-i, xt) = min P t i{ht-i, xt), where Pti(h t -i,xt) is the projection 
of Pt{ht~i,xt) on the z-th dimension. Then the correspondence Pu is mea¬ 
surable and compact valued, and /3j is Borel measurable. Let Ai(h t -\,xt) = 
{(3i(ht-i,xt)} x [ 0 , 7 ] n_1 , where 7 > 0 is the upper bound of Pt. Denote 
A'(fo_i,xt) = Ai(ht-i,xt) fl Pt(ht-\,xt). Then A' is a measurable and compact 
valued correspondence, and hence has a Borel measurable selection j3[. Note that 
is a Borel measurable selection of Pt. Let 


g t (ht-i,x t ) = 


{ P[{ht-\,xt) if h t -1 € H t -i,x ti £ B ti (h t -i) and x tj £ B tj (h t -i),Vj / z; 
g(ht-i , xt) otherwise. 

Notice that 


{{ht—i,Xt) £ Gr(A t ). ht— 1 £ Ht—\,Xtt £ Bti(ht—i) and Xtj ^ Btj{ht—i),^j 7 ^ L } 


Gr(Aj) D Ujg/ J (Gr(B^) x n.Vj)\(U^(Gr(By)*n x tk ))), 

Mi 
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which is a Borel set. As a result, gt is a Borel measurable selection of Pt . Moreover, 
9t{ht-i,x t ) = pt(ht-i,x t ) for all h t - 1 € H t - 1 and /t(-|/^-i)-almost all x t . 

Fix a subgame ht- 1 € Ht-\- We will show that /t(-|hi_i) is a Nash equilibrium 
given the payoff gt(ht~ 1 , •) in the subgame ht- 1 - Suppose that player i deviates to 
some action xu- 

If xu G Bti(ht- 1 ), then player V s expected payoff is 


Jr 


'A t (_i)(h t - 1 ) 






< 


fte {ht —i; xu, Xt(—i))ft(—i) (d®j(_i) i) 

9 ti{ht —11 Xt^_i^) ft(—i) {dx t (-i) \ht-i) 

Pi(ht-i,x u , a;t ( -j))/t(-i)(dx t (_ i ) |/?t-i) 

Pti(ht -11 Xu, Xt(_i))ft(—i) i) \ ht—\) 


< 


I Pti{ht —11 ^t(—£)) i) |^£— 1) 

' A t(-i){ h t- 1) 

r 

Pti{ht-i,xt)ft(dx t \ht-i) 


<A t (ht- 1) 


lA t (h t -i) 


gti{ht-i,xt)ft{dx t \ht-i). 


The first and the third equalities hold since = 0 for each j, 

and hence The second 

equality and the first inequality are due to the fact that gti{ht-i,xu,x t r_{\) = 
Pi(ht-i,xti,x t (-i-)) = min Pu{h t -\, xu , x t (_^) < p ti {h t -i, x ti , x t (_^) for x t ^ G 
The second inequality holds since ft(-\ht-i) is a Nash equilibrium 
given the payoff pt.{ht- 1 , •) in the subgame ht- 1 - The fourth equality follows from 
the fact that gt(ht-i,xt) = pt{ht-\, xt) for /i(-|/q_i )-almost all xt- 
If xu Bu{ht- 1 ), then player i’s expected payoff is 


' A t (-i)(ht-i) 


'n^i B c tj {h t - 1) 


9ti{hf— 1, |hj_i) 

9 ti{ht —i , Xt(—i))ft(—i) {dx t (-i)\ht-\) 

i 

9i{ht-l, Xti, Xp—ij ) ft(-i') {dXt(— 2 ) | ht— \ ) 


< 


B^(ht- 1 ) 

I 9i {ht— 1 > > Xt(_ j) )/t(— j) |hj_i ) 

' A t (-i){h t -i) 

/ p t i(h i _i,xt)/t(dx t |/rt_i) 

>At{ht- 1) 
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= / gti(ht-i,xt)ft(dx t \ht-i). 

J At(ht- 1 ) 

The first and the third equalities hold since 






ft{-i) ( A-t(-i) {h t - 1) | h t -\). 


The second equality is due to the fact that gu(ht-i,xu, x t (-i)) = gi(ht-i, xti, x t (-i)) 
for G Tij^i The first inequality follows from the definition of B t i, 

and the fourth equality holds since gt(ht-\, Xt) = pt(ht-i, Xt) for /t(-|/it_i)-almost 
all xt- 

Thus, player i cannot improve his payoff in the subgame ht by a unilateral 
change in his strategy for any i G I, which implies that ft(-\ht~i) is a Nash 
equilibrium given the payoff gt.(ht~ 1 , •) in the subgame ht- 1 - 


Step 3. For any (ht-i,xt) € Gr(Aj), 


Pt(h t - i, 



Q t+ i(h t -i,xt,st)fto{ds t \h t -i). 


By Lemma 6, there exists a Borel measurable mapping q from Gr (Pt) X St to M n 
such that 

1. q(h t -i,x t ,e,s t ) <G Q t+ i(h t -i, x t , s t ) for any (h t -i,x t ,e,s t ) G Gr(P jS ) x S t ; 

2. e = f St q(ht-i,x t ,e,st)fto(ds t \ht-i) for any (h t -i,x t ,e) € Gr (P t ), where 
(h t -i,x t ) G Gr (A t ). 

Let 

q t+ i{ht-i,xt,s t ) = q(h t -i,xt,gt(ht-i,x t ),s t ) 

for any (h t -±,xt,st) G H t . Then q t+ \ is a Borel measurable selection of Qt.+i- 
For (h t -i,x t ) G Gr(^), 


gt(h t -i,x t )= / q(ht-i,xt,gt(ht-i,xt),st)fto(ds t \h 

Js t 

= / q t+ i(ht-i,Xt,St)fto(dst\h t -i). 

JSt. 


Therefore, we have a Borel measurable selection qt,+\ of Qt.+i , and a Borel 
measurable mapping f t : H t -1 —>• ®i^iM.(X t i) such that for all ht -1 G H t - 1 , 
properties (l)-(3) are satisfied. The proof is complete. □ 

If a dynamic game has only T stages for some positive integer T > 1, then let 
Qt+i(J vr) = { u (hr)} for any hr G Ht, and Qt = <h(<5t + i) for 1 < t < T — 1. We 
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can start with the backward induction from the last period and stop at the initial 
period, then run the forward induction from the initial period to the last period. 
Thus, the following corollary is immediate. 

Corollary 4. Any finite-horizon dynamic game with the ARM condition has a 
subgame-perfect equilibrium. 

5.3.3 Infinite horizon case 

Pick a sequence f = (£i,£ 2 , ...) such that (1) f m is a transition probability from 
H m -1 to M(X m ) for any m > 1, and (2) £ m (A m (h m -i)\h m -i) = 1 for any m > 1 
and h m -\ € H m - Denote the set of all such £ as T. 

Fix any t > 1 , define correspondences and A| as follows: in the subgame 
ht —i , 

^t(fo-i) = A4(A t (ht- 1)) <8> At, 

and 

Af(fo-i) = M(A t (h t _ i)) ® fto(h t -i). 

For any m\ > t, suppose that the correspondences H) ni_1 and A) ni_1 have been de¬ 
fined. Then we can define correspondences E'f 1 : H t -\ —> M. {Y\t^ m < mi (X m x S m ) 

and A™ 1 : H t - i M ( Ilt<m<mi( X m x S rrS) as follows: 

H™ 1 (h t - 1 ) ={g(h t - 1 ) o (£ mi (h t -i, •) <S> A mi ): 

g is a Borel measurable selection of , 

fmi is a Borel measurable selection of AA(A mi)}i 


and 


A” ll (/it_i) = {fl'(ht— i ) o (( mi (ht—i , •) <8> fmio(ht-i, •)) : 

5 is a Borel measurable selection of A™ 1-1 , 

£ mi is a Borel measurable selection of A4(^4 mi )}, 


where Ai(A mi ) is regarded as a correspondence from H mi -\ to the set of Borel 
probabilities on X , 


mi • 


For any mi > f, let p|)') i ^ be the probability 

on n t < m < mi (X m x S' m ) which is induced by {A m } t < m < mi and {f m }t<m<m i, and 
i$) ^ ^ ie P r °b a bility on rif<m<mi (Xm x 'S'm) which is induced by 

{/mo}f<m<mi and {£ m }t< m < mi . Then ~” !l (/it_i) is the set of all such p^^y 
and A” ll (ht_i) is the set of all such p”*) i Notice that ^ € A” ll (/it_i) if 
and only if p™) i ^ € H” ll (/it_i), and p™^ i ^ and p)))) i ^ can be both regarded 
as probability measures on H mi (ht- 1 ). 
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Similarly, let p(ht-i,£) be the probability on x S m ) induced by 

{A m }m>t and {£ m } m >t, and Q(h t -i£) the probability on Yl m > t (X m x S m ) induced 
by {fmo}m>t and Denote the correspondence 

E t : Ht^ ^ x S m )) 

m>t 

as the set of all such P(h t _i£), and 

A t : Ht.i-> x S m )) 

m>t 

as the set of all such 

Lemma 17. For any m\ > t and ht~ 1 G Ht-ij 


mi 

Q {ht-1,0 


| [ Pmo{ht-l 


, n mi 27 

P {ht- 1,0’ 




Proof. Fix £ G Y, and Borel subsets C m C X m and D rn C S m for m > t. First, we 
have 


elht-i&iCt X D t ) 

= UCtlkt-x) ■ MD t \ht-i) 

= / SctxDt(xt,st)pto{ht-i,st)(£t(h t -i) <g> A t )(d(xt,st)), 
JXtxSt 


which implies that Q\ ht _ lt ^ = <Pto{h t -i,-) ° P\h t ^)- 

Suppose that Q™ t _ u Q = (]lt< m <m 2 <Pmo{h t - 1 , •)) for some m 2 > t. 

Then 

( II X Dm ^ 

U<m<m2+1 

= ^ (^2+1 iht—lt ') ® /(m2+l)o(^—1? *)) ( (Cm x Dm) 

U<m<m2+1 

27 For m > t > 1 and h t -\ G H t - 1 , the function ip m o(ht-i, •) is defined on x S'™,, which is 

measurable and sectionally continuous on IIt<fc<m-i By Lemma 4, ip m o(h t -i, •) can be extended to 
be a measurable function ip m o(ht-i, •) on the product space Ylt<k<m-i X k x n#<fc< m which is also 
sectionally continuous on Ylt<k<m-i Xk- Given any £ G T, since p r ff lt _ 1 £) concentrates on H m (h t - 1 ), 
V5 m0 (/i t _i, •) ° P(h t _ 1 ,f ) = ^mo(hi-i,') ° Pfht-i^y For notational simplicity, we still use •), 

instead of </? m o(ht-i, •), to denote the above extension. Similarly, we can work with a suitable extension 
of the payoff function u as needed. 
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L 


’n 


t<m<rri2 +1 


^Ylt<m<m 2 (^mX'S'm) *'^m 2 + l x ^m 2 + l 
Cm2+1 ® /()n2+l)o(d(®m2+l) ^TO2+l) l^t—1 > x tt • • • 5 ^rri2 j j • • • j ^m2 ) 
• 5 «^m2 ) * * * ) ^m2 )l^-l) 


( Cm,xD m ){ X tl ■ ■ ■ , ®m 2 + l) S t) ■ ■ ■ l %2+l)' 


L 


f f 

1 JX. 


°n 


_ t<m<m „ +1 (C , m xD m )( a; t) • • • )®m 2 +l> • • • > Wl)' 

'a< m < m2 (^mx5 m ) ^S m2+1 yx m2+1 ( - m - m2+1 

< ^’(»772 + l)o(^—1> x ti ■ ■ ■ 1 x m 2 , St, ■■■ , S m2 -f 1 )^m 2 +l (da: TO2+ i|/l(_i, Xt, ■■■ , X m2 , St, ..., s m2 ) 

■^(m2+l)o(d-Sm2+l) | (Pmoiht—lyXt,..., %m—l •> Sti • • • 5 ^m) 

t<m<rri2 

• 5 *£ 777.2 1 ^t'l • • • 1 Srri 2 )\ht-i) 

= / %<m<m, + l( C '» xD "*)( It ’ ' ' ' ’ Xm 2 + 1 ) S l> • • ' ) S m 2 + l)' 

a< ra < m2+ iaxSJ t< m <m 2+ i 

( PmO (ht —1 , x t, ■ ■ ■ 1 x m—l, St, ■■■ , (^(^> ' ■ ■ > ^7712 1 St., ■■■ , S m2 ) | /it—1), 

t<777,<77l2 + l 

which implies that 


7772 + 1 
6 (ht- i,0 


I 


J~][ Pmoiht-l, 

\t<m<m2-\-l 


°P7n +l 


,tr 


The proof is complete. □ 

Lemma 18. 1. For any t > 1, the correspondence A™ 1 is nonempty and 

compact valued, and sectionally continuous on X t ^ 1 for any m\ > t. 

2. For any t > 1, the correspondence At is nonempty and compact valued, and 
sectionally continuous on X f ~ l . 

Proof. (1) We first show that the correspondence S™ 1 is nonempty and compact 
valued, and sectionally continuous on X t ~ 1 for any mi > t 
Consider the case m\ = t > 1, where 


~\{ht- 1 ) = M{A t (ht- 1 ))®\t. 

Since A t i is nonempty and compact valued, and sectionally continuous on X t_1 , 
rf is nonempty and compact valued, and sectionally continuous on A* -1 . 

Now suppose that S™ 2 is nonempty and compact valued, and sectionally 
continuous on X t ~ 1 for some m 2 > t > 1. Notice that 

(ht— 1 ) ={g(ht-i) o (^ m 2 +i(/it-i, •) < 8 > A( m 2 + i)): 

g is a Borel measurable selection of H™ 2 , 
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£ m2+ 1 is a Borel measurable selection of M.(A m2+ i)}. 

Define a correspondence A\ from Ht~\ x St to Xt as A\(h t -i,s t ) = A t (h t - 1 ). 
Then A\ is nonempty and compact valued, sectionally continuous on Xt— 1 , and has 
a B(X t x S^-measurable graph. For any (si,..., st), since H t -i(si ,..., St- 1 ) is 
compact and A t (-, s 1 ,..., st-i) is continuous and compact valued, A\(-, s\,... ,st) 
has a compact graph by Lemma 3 ( 6 ). For any ht -1 G H t -1 and r G E\(ht- 1 ), the 
marginal of r on S* is Aj and r(Gic(A t t (ht-i, •))) = 1. 

For any mi > t, suppose that the correspondence 

A™- 1 : Ht-tx J] H X m 

t<m<mi—l t<m<mi — l 

has been defined such that 

1 . it is nonempty and compact valued, sectionally upper hemicontinuous on 
Xt-i, and has a B(X mi ~ 1 x 5 mi_1 )-rneasurable graph; 

2 . for any (si,... .s mi _i), A™ 1 ^ 1 ^, si,... .s mi _i) has a compact graph; 

3. for any ht-i G H t ~i and r € the marginal of t on 

Y\t<m<mi—i i® and x(Gr(^4^ (ht— l,'))) — !• 

We define a correspondence A™ 1 : H t -i x -► n t < m < mi as 

follows: 

(ht —1 j Sti • ■ ■ i S mi ) —j • • • j ^mi ) • 

^mi ^ {ht— 1 5 ? • • • 5 ^mi-l 5 5 • • • 5 % 1 - 1)5 

(®t, • - ^mi -1 ) £ (ht— 1 , ■ ■ ■ , Smi-l)}‘ 

It is obvious that A™ 11 is nonempty valued. For any (s\,... ,s mi ), since 
A r i ^ 1 (') si,... .s mi _i) has a compact graph and A mi (-, si,..., s mi -i) is continu¬ 
ous and compact valued, A™ 1 ^, si,... .s mi ) has a compact graph by Lemma 3 ( 6 ), 
which implies that A™ 1 is compact valued and sectionally upper hemicontinuous on 
X t -\. In addition, Gr(^ ni ) = Gr(T mi ) x S rni , which is B(X mi X S mi )-measurable. 
For any ht -1 G Ht -1 and r G H ^ 711 (hf_i), it is obvious that the marginal of r on 
Y\t<m<mi Sm IS and r(Gr (A™ 1 (h t -i, ■))) = L 

By Lemma 13, S " 72+1 is nonempty and compact valued, and sectionally 
continuous on X t—1 . 

Now we show that the correspondence A ™ 1 is nonempty and compact valued, 
and sectionally continuous on X l ~ l for any m\ > t. 

Given and a sequence {xq,x\, ... ,x^_ 1 } G H t -i(s t ~ 1 ) for 1 < k < 00 . Let 
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hf'_ } = (s* 1 , (xg, x \,..., xjL-J). It is obvious that A ™ 1 is nonempty valued, we 

first show that A ™ 1 is sectionally upper hemicontinuous on X t_1 . Suppose that 

e (/*f_i,£ h ) € for 1 < k < oo and .. - ,«?*_].) (xo°,Xi°, • • - 

we need to show that there exists some £°° such that a subsequence of fc . 

(At —1»€ ) 

weakly converges to and ^ € A™ 1 ^^). 

Since H ™ 1 is sectionally upper hemicontinuous on X* , there exists some £' 
such that a subsequence of p"?l e]rS , say itself, weakly converges to eao \ ar 


and 


bmce is sectionally upper hemicontinuous on A , there exists some 
such that a subsequence of p r ^ k ^ k y say itself, weakly converges to p'^ x 
P e sr(^r). Then ^L ij?do) € A^Wi)- 

For any bounded continuous function i/> on rit<m<mi (-^m x Sm)i let 

Xk(.Xt, ■ ■ ■ i 2-mi j St , ■ ■ ■ , S mi ) = 

ip(xt, • • • , Xmi j St, ... , %i ) ' 11 if^t —1 > Xti ■ ■ • i Xm—l i St, . . . , S m ). 

Then {xt,} is a sequence of functions satisfying the following three properties. 

1. For each fc, Xfc is jointly measurable and sectionally continuous on X. 

2. For any (st,..., s mi ) and any sequence (x^,..., x"j ) —> (xf 3 ,..., x~ ) in X, 
Xk(xt,-- -,x^ v s u ... ,s mi ) ->■ Xoo(Xf°, ■ ■ ■ ,x~,st,-.. ,s mi ) as k oo. 

3. The sequence {Xfc}i<fc<oo is integrably bounded. 

By Lemma 14, as fc —> oo, 


rit<m<mi ( XmXSm) 


Xk(x t ,.--, %mi 5 &t ? • • • ? ^mi )^) ( ^- ■ > x mi , S(, • • •, s mi )) 


^Ilt^m^mj (XmXSm) 

Then by Lemma 17, 


XoofXt,..., ®mi > St > • • • > Smi )P[h°a i ^oo) (c3(a;t,..., x nil , St,..., s mi )). 


V>(xt,..., j • j • ■ • 5 )) 


n i<m < mi ( Xm'XSm ) 


ip(x t ,..., 

5 5 * * * } %1 )P(h °° ■ ■ ■ j Xmi, St, ■ ■ ■ , S mi )), 


which implies that p™*. ^ weakly converges to Therefore, A ™ 1 is 

sectionally upper hemicontinuous on X t_1 . If one chooses fcj _ 1 = = • • • = 

/i“ 1 , then we indeed show that A ™ 1 is compact valued. 

In the argument above, we indeed proved that if /XT fc . weakly converges to 
then p™ 1 *, weakly converges to ] 

The left is to show that A ™ 1 is sectionally lower hemicontinuous on X* -1 . 


42 


Suppose that (xg, xf ,..., Xf_i) -> (xg°, x ™,..., x“ x ) and ^oo^oo) G 
we need to show that there exists a subsequence {(xg m , x^’ m ,..., x^Ti)} of 
and G ^( h t- 1 ) for each such that 

weakly converges to ^y 

Since gj^oo^oo) G AJ ni (/i^ 1 ), we have pj^oo^oo) G Because 

Ej” -1 is sectionally lower hemicontinuous on X t ~ 1 , there exists a subsequence of 
{(xg, x\, ..., xfi)}, say itself, and p™l fc € E™ 1 {h k _ x ) for each A: such that 

(At—l>s J 

p™ t l $fc) weakly converges to As a result > ^ weakly converges to 

qJ'^oo ^ooy which implies that A™' 1 is sectionally lower hemicontinuous on X t l . 

Therefore, A™ 1 is nonempty and compact valued, and sectionally continuous 
on X t_1 for any mi > t. 


(2) We show that At is nonempty and compact valued, and sectionally 
continuous on X t—l . 

It is obvious that At is nonempty valued, we first prove that it is compact 
valued. 

Given ht-i and a sequence {r fc } C A t (ht-i), there exists a sequence of {£ fc }fc>i 
such that £ fc = (£i,£f,...) € T and r fc = for each k. 

By (1), E( is compact. Then there exists a measurable mapping gt such that (1) 
9 t = (£!>•••) l, 9t, €t+ 1: • • •) G T, and (2) p\ ht _ u ^ weakly converges to p\ ht _ ug ty 
Note that ,} is a Borel measurable selection of _M(^4*+ 1 ). By Lemma 13, there 
is a Borel measurable selection g t +1 of M.(A t+ i) such that there is a subsequence 
°f {Plht-i,^)}’ say itself ’ which weakl y converges to P^_ ]CJ t + iy where g t+l = 
(Cl > ■ ■ ■ j Ct—i) 9t, 9t.+ 1) Cif2) • • •) G T. 

Repeat this procedure, one can construct a Borel measurable mapping g such 
that P(h t _ i, s ) is a convergent point of {p(h t -i,^ k )}- Thus, Q(h t ~i,g) a convergent 
point of {P( ftt _ li? fe)}. 

The sectional upper hemicontinuity of A^ follows a similar argument as above. 
In particular, given s t ~ l and a sequence {xg,xf,...,x^_ 1 } C H t -i(s t-1 ) for 
k > 0. Let h\_i = (s t_1 ,(x, q, xj,..., xjL 1 )). Suppose that (xg, xf,..., x^_ x ) —> 
(x(j,x5, • • • ,x°_ 1 ). If {r k } C A t{h k _i) for L > 1 and r fc —> r°, then one can show 
that r° £ Ai(/i^ ) _ 1 ) by repeating a similar argument as in the proof above. 

Finally, we consider the sectional lower hemicontinuity of A^. Suppose that 
t° £ A t (ht_i). Then there exists some £ £ T such that r° = Denote 

f m = g™ 0 ^ £ AJ Tl (Ai^ l _ 1 ) for m > t. As A™ is continuous, for each m, there 
exists some £ m £ T such that , f m ) < T for sufficiently large, where 

d is the Prokhorov metric. Let r m = Then r m weakly converges to r°, 

which implies that A* is sectionally lower hemicontinuous. □ 
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Define a correspondence Qf [: Ht-i —> M+. as follows: 


QUht- 1 ) = 

0 (ht- 1,0 G Mht-i)Y, t > r; 

^(Q[+l)(^-l) t<T. 

Denote Q%° = n r >iQJ". 

Lemma 19. For any t,r > 1, Qf is bounded, measurable, nonempty and compact 
valued, and essentially sectionally upper hemicontinuous on X t_1 . 

Proof. We prove the lemma in three steps. 

Step 1. Fix t > t. We will show that Q\ is bounded, nonempty and compact 
valued, and sectionally upper hemicontinuous on X 1 ^ 1 . 

The boundedness and nonemptiness of Ql are obvious. We shall prove that 
Q1 is sectionally upper hemicontinuous on X t ~ 1 . Given s t_1 and a sequence 
{xq, x k , ..., x k _ x } C for k > 0. Let h k _ x = (s t_1 , (xfi, x k , ..., x k _ x )). 

Suppose that a k G Qt{h k _ x ) for k > 1, (xjj,x k ,... ,x k _ x ) —> (xq,®] 1 , ... ,x°_ 1 ) and 
a k —> a 0 , we need to show that a 0 G QKh^^). 

By the definition, there exists a sequence {f k }k>i such that 


a k = 


Ylm>t(XmX Sm) 


u(h k _ 1 ,x, s)g {h k_ i ^ k) ( d(s, s)), 


where £ k = (£f, £2 j ■ ■ •) £ T for each k. As A t is compact valued and sectionally 
continuous on X* , there exist some Qq } o ^ G A t (h^_ 1 ) and a subsequence of 
Q(j,k £ky say itself, which weakly converges to g^ h o ^o) for £° = (£i,£ 2 , ...) G T. 


H- l ’ 1 

We shall show that 


a° = 


u{h° t _ l ,x,s)g {h o_ i ^){d{x,s)). 


Tlm>t(Xm X-Sm) 

For this aim, we only need to show that for any <5 > 0, 


a 0 - 


'Tlm>t(Xm'XSm) 


u(h^_ 1 ,x,s)g {h o_ ii o ) (<Yx,s)) 


< 6. 


(3) 


Since the game is continuous at infinity, there exists a positive integer M > t 
such that w m < y } 8 for any m > M. 

For each j > M, by Lemma 4, there exists a measurable selection of Xi(Aj) 
such that £'■ is sectionally continuous on . Let p: Hm ~> W m ;>M^m X 
S m ) be the transition probability which is induced by £m+ 2 > • • •) aR d 
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{/(M+i)o> /(M+ 2 ) 0 ; • • •}• By Lemma 9, /x is measurable and sectionally continuous 
on X M . Let 

Viwiht-i,x t ,- - -, xm, st, ■ ■ ■, sm ) = 

/ u(ht~i, Xt ,..., xm, St, ■■■, sm, x, s) d/x(x, s|fo_i, xt, ■ ■ ■, xm, st, ■ ■ ■, sm )• 

IIm>M (-Km X Sm) 

Then Lm is bounded and measurable. In addition, Vm is sectionally continuous 
on X M by Lemma 14. 

For any k > 0, we have 




u{h!t_ u x, s)g [h k_ i ^ ) ( d(x, s)) 


Tlt<m<M(Xm'XSm) 


Vm (J^t — 1 > Xt i ■ ■ ■ i XM, St, ■ • • j SMQ (j-Jc i (d(x£ , - ■ ■ ; XM, St, • • • , SM ) ) | 


< w 

< -4. 
5 


M+l 


Since g^ h k ^ ^k ) weakly converges to g ^ h o i go) and g^ k ^ is the marginal of 
9 (h k _ 1 ,^ k ) on n t<m<M( x m x S m) for any k > 0, the sequence g™ also weakly 
converges to g^o ^ 0 y By Lemma 14, we have 


V M (ht —l , Xt, • ■ ■, xm, st, - • •, s m ) Q^ti k ^ (b(x ^, • • •, x m, st, - • •, s m )) 


T[t<m<M(Xm.xSm) 


Tlt< Tn <M( XrnX Srn) 


VM(.ht_ l ,x t ,.. . ,XM, St, - ■ ■ , Sm)Q™ 0 £ 0 )(A x t , ■ ■ ■ ,XM, St,- - ■, SAf))| 


< -(5 
5 


for k > K\. where K\ is a sufficiently large positive integer. In addition, there 
exists a positive integer I \2 such that \a k — a°| < for k > K- 2 - Combining the 
inequalities above, we prove inequality (3), which implies that QJ is sectionally 
upper hemicontinuous on X t_1 for t > r. 

Furthermore, to prove that Ql is compact valued, we only need to consider 
the case that {xq, x\,..., x^_ 1 } = {x[j, x?,..., x°_ 1 } for any k > 0, and repeat the 
above proof. 


Step 2. Fix t > t, we will show that QJ is measurable. 

Fix a sequence (^' 1 ,^ 2 , • • ■)> where £'• is a selection of Xi(Aj) measurable in s- 7-1 
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and continuous in x 3 1 for each j. For any M > t, let 


i,x t ,x M , s M ) = 


< / u{h t -\,x t ,.. 

• ? %M j $t 5 • • 

• ) Sm, X, (d(x, s)) /• 

[ Jn m >MXmXS m ) 


J 


By Lemma 9, g(h t - 1 , Xt ,..., X M,st,...,s M ^) is measurable from H M to M ([] m > M ( x m x S m )), 
and sectionally continuous on X AI . Thus, Wj$ is bounded, measurable, nonempty, 
convex and compact valued. By Lemma 14, Wj$ is sectionally continuous on X M . 

Suppose that for some t < j < M, W 3 M has been defined such that it is bounded, 
measurable, nonempty, convex and compact valued, and sectionally continuous on 
XK Let 


w lt 1 (JH —1 j X t , ■ • • , Xj —\, Sf, ■ ■ ■ , Sj—l) = 

J Xj x Sj 

^ht-UXt^Xj-uSt,...^-!,® € Xj- 1, St ,..., Sj-i), 

w 3 M is a Borel measurable selection of W 3 M }. 


Let Sj = Sj. Since 


W 3 M (ht-i,x t , ...,Xj,s t ,..., ._ 1)Stv .. iS ._ li0 (d(x j , Sj )) 

W 3 M (h t -i,x t ,.. .,Xj,s t ,... ,Sj)pl ht _ uXt ^ x ._ it 8ti ... tS ._ lA) «Xj,Sj)) 
<Pjo(ht-i, Xt, ■■■, Xj— i, St, ■ ■ ■, Sj)Xj (dsj), 


we have 


W 3 m (h t -i,x t ,... ,Xj-!, s t ,..., Sj-i) = 


v O j v y\. j X Oj 

^Pjoi^^H—i 5 ^ti • • • j Xj—i') Sti • • • 5 Sj)\j (dsj) * 
p’(ht-i, xt ,...,x j - 1 ,st,...,s j - 1 £) G ^ j j( h t-l,Xt, . . . ,Xj-i,S t , . . .,Sj- 1), 

w 3 m is a Borel measurable selection of W 3 M }. 


Let 


W 3 M (h t -i,x t ,.. ■, Xj—i, s t , ...,Sj) = 
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</, 


w 


M 


( ht-uxt , Sj ) • *4*-!,**,.®j)) : 


G ■ ■ -,Xj-l ,S t ,.. .,Sj- 1), 

is a Borel measurable selection of W 3 M }. 


Since W 3 M [ht-\,xt ,..., Xj, s t) ..., Sj) is continuous in Xj and does not depend on 
Sj, it is continuous in (x.,-, Sj ). In addition, IT^- is bounded, measurable, nonempty, 
convex and compact valued. By Lemma 10, W 3 M is bounded, measurable, 
nonempty and compact valued, and sectionally continuous on X ] ~ 1 . 

It is easy to see that 


W M 1 ( h t-hX t , ■ ■ ■ .. .,Sj- 1 ) = 

/ (.ht—i, xt, ■ ■ • , Xj—i, st, ..., SjVj 0 (^-i i xt, ..., Xj— i, St,..., Sj)Aj (dsj) . 

JSj 

By Lemma 5, it is bounded, measurable, nonempty and compact valued, and 
sectionally continuous on X J—1 . 

Let IT = Ua/^IT^ 1 - That is, IT is the closure of U m>iWm, which is 
measurable due to Lemma 3. 

First, W C Q1 because W C for each M >t and Q\ is compact valued. 
Second, fix ht-i and q £ QJ(ht-i). Then there exists a mapping £ £ T such that 


Q = 



(Xm X Sm) 


u(h t - 1 , x, s)^ t _ 1 ,^)(d(x, s)). 


For M >t, let 


VM{ht-l,x t , . . . , X M , St,. ■ ■ , Sm) = 




u(ht —i , Xt, ■ ■ ■, xm, St, ■ ■ ■, sm, x, s)^( ht _ 1 


Xt,...,XM,St,...,SM 


£)(*>«) 


and 


= 


V M (h t - 1 , x, s)^_ i e) (d(x, s)) 


^Ilf<m<MpL™ x Sm) 


Because the dynamic game is continuous at infinity, qm —>• < 7 , which implies that 
q £ IT(/h-i) and C IT. 

Therefore, IT = QJ", and hence QJ" is measurable for t > t. 


Step 3. For t < r, we can start with Q£ +1 . Repeating the backward induction 
in Section 5.3.1, we have that QJ is also bounded, measurable, nonempty and 
compact valued, and essentially sectionally upper hemicontinuous on X t ~ 1 . □ 

The following three lemmas show that Qf{ht- 1 ) = d^Qf+iX^-i) = E t (ht~ 1 ) 
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for A 4 1 -almost all ht-i £ Ht- 1- 28 

Lemma 20. 1. The correspondence is bounded, measurable, nonempty and 

compact valued, and essentially sectionally upper hemicontinuous on X f ~ l . 

2. For any t >1, Qf°(ht- 1 ) = <3?((3t+i)(^t-i) f or A 4 ^ 1 -almost all ht -1 £ H t - 1 - 

Proof. (1) It is obvious that Qf 3 is bounded. By Lemma 3 (2), Qf 3 is measurable. 

It is easy to see that if t\ > T 2 , then Qf 1 C Qf 2 . Since Qf is nonempty and compact 
valued, Qf 3 is nonempty and compact valued. 

Fix any s 4_1 G S '* -1 such that Q}(-,s 4_1 ) is upper hemicontinuous on 
Ht-\(s t ^ 1 ) for any r. By Lemma 3 (7), <3£°(-,s 4_1 ) is upper hemicontinuous on 
H t -\(s t ^ 1 ). Since Qf is essentially upper hemicontinuous on X l ~ l for each r, Qf° 
is essentially upper upper hemicontinuous on X f ~ l . 

( 2 ) For any r, $(Qt+i)(^t- 1 ) C <&(Q T t+l ){h t -i) C Q T t {h t - 1 ), and hence 

The space {1,2,... oo} is a countable compact set endowed with the following 
metric: d(k,m ) = A — for any 1 < k, m < oo. The sequence {Q{ + 1 }i< r <oo 
can be regarded as a correspondence Qt+i from H t x {1,2,, oo} to M n , which 
is measurable, nonempty and compact valued, and essentially sectionally upper 
hemicontinuous on X f x {1,2,... ,oo}. The backward induction in Section 5.3.1 
shows that is measurable, nonempty and compact valued, and essentially 

sectionally upper hemicontinuous on X t x { 1 , 2 ,... ,oo}. 

Since 4>(({h + i) is essentially sectionally upper hemicontinuous on X 4 x{l, 2 ,..., oo}, 
there exists a measurable subset S ’ 4-1 C S ' 4-1 such that A 4 _ 1 (S' 4_1 ) = 1, and 
T((5t+i)(-, ■, s 4 ^ 1 ) is upper hemicontinuous for any s 4_1 G S' 4-1 . Fix s 4_1 £ 

S' 4-1 . For h t - 1 = (x 4 _ 1 ,s 4_1 ) £ H t -\ and a £ Qfffht- 1 ), by its definition, 
a £ Q T t {h t - 1 ) = §{Q T t+l ){ht-i) for r > t. Thus, a £ ^(Qff^fht- 1 ). 

In summary, Qf°(ht-i) = ^{Q < ff_ l )(ht- 1 ) for A 4_1 -almost all ht- 1 G H t - □ 

Though the definition of QJ involves correlated strategies for t < t, the 
following lemma shows that one can work with mixed strategies in terms of 
equilibrium payoffs, due to the combination of backward inductions in multiple 
steps. 

Lemma 21. If ct is a measurable selection o/d>(Q^. 1 ), then ct(ht- 1 ) is a subgame- 
perfect equilibrium payoff vector for A 4-1 -almost all ht -1 G H t -%■ 

28 The proofs for Lemmas 20 and 22 follow the standard ideas with some modifications; see, for 
example, Harris (1990), Harris, Reny and Robson (1995) and Mariotti (2000). 
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Proof. Without loss of generality, we only prove the case t = 1. Suppose that c\ is 
a measurable selection of $((5^°). Apply Proposition 5 recursively to obtain Borel 
measurable mappings {fki}iei for k > 1. That is, for any k > 1, there exists a 
Borel measurable selection c k of such that for Afc_i-almost all h k -i £ H k ~ 1 , 

1- fk(hk~ i) is a Nash equilibrium in the subgame h k ~ i, where the action space 
is Aki(hk- 1 ) for player i € I, and the payoff function is given by 


2 . 


Cfc {hk—l ) 


L 


c k+ i{h k -i 


/ / c k+ i(h k 

JAk(h. k - 1 ) JS k 




— l ) j 'Sfc)/fco(dsfc | hk~i)fk (dxfc | hk— i )• 


We need to show that ci(/io) is a subgame-perfect equilibrium payoff vector for 
Ao-almost all ho £ Hq. 

First, we show that {/fcijig/ is a subgame-perfect equilibrium. Fix a player j 
and a strategy g 3 = }fc>i - By the one-step deviation principle, it suffices to 
show that for any t' > 1, A 4_1 -ahnost all hf— i, and any 5 > 0, 


Y\m>t' (XmXSm) 


> 


Tlm,>t'(XmXSm.) 


Uj{h v _ i,®, s)£» (v _ iJ) (d(x, s)) 

Uj(h t/ _ i,x, a)e ( h t ,_ 11 (/_ Jl s i) )(d(*,«)) - 


where /yy (1/iy? • ■ • idt’ji f(t'+i)ji f(t’+ 2 )ji ■ ■ •)• 

Since the game is continuous at infinity, there exists a positive integer 
M > if such that w m < for any m > M. By Lemma 20, c k {hk~ i) £ 
$(Q£J_i)(%-i) = Q™(h k - 1 ) = n r >iQ^(/i fe _i) for A fc _i-almost all h k _ 1 £ H k -i- 
Since Q T k = <f ' T ~ k+l {Q T T+l ) for k < r, c k {h k - 1 ) € n T >i$ r_fc+1 (Q^ +1 )(/i fc _i) C 
§M~ k+1 {Q% +1 ){h k -i) for Afc_i-almost all h k -1 £ #fc-i. 

Thus, there exists a Borel measurable selection w of Q%+l an d a strategy profile 
£ such that for Ajyy_i-almost all Hm-i £ Hm- i, 

1. is a Nash equilibrium in the subgame Hm-i-, where the action 

space is AMiifiM- 1 ) for player z £ /, and the payoff function is given by 



*) sm)/mo(c!sm|^m-i)- 
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2. 




' A M {h M -i) 



w(hM-l,XM, SM)fMo(dsM\hM-l)fM(dxM\hM-l)- 


3. w(h M ) = /n ro > M+l( x mX 5 m) ^M,x, S )^ M)0 (d(x, S )). 
Therefore, we have 
1. for Ao-almost all ho € iLo> 


ci (h 0 ) = / «(h 0 ,x,sW 0 m(d(2;,s)), 

^ri ra >l(^m x Sm) 

where f' k is ,f) : if k < M, and if k > M + 1; 

2. for 1 < h < M, fk(hk~ i) is a Nash equilibrium in the subgame hk~i for A fc_1 - 
alrnost all hk ~i € Hk- 1 , where the action space is Aki(hk~i) for player < £ I, 
and the payoff function is given by 



' n m >fc+i X Sm ) 


U ( _ i, X/c, Sfc, X, s) Q((hk_i,Xk,Sk),f f ) (*^(x, S') ) fki) (dSfc \ Hk—\) • 


Let g' = (gij, ..., g t ' j , • • •, Imj, £(m+i)j, • • •)• % ( 2 )> for A*' ^almost 

all ht'-i € 


’Umyt'iXmXSm) 


Uj{h t >- i,x, s)Q(h t ,_ 1 ,{f'f'))( ( Kx, s)) 


J n ?n >t' x S m ) 


In addition, for any h t '_\ 




and 


u j(h t '-i,x, s)e( ht ,_ 1 > (f_ g’)) (d(x, s)) 


> [ « i (h t /_i,x,s)g (fc (/ 5 )) (d(x,s)) - -5, 

^Ylm>t' ( Xm'XSm ) 




(ht'-i, ®, a )e(ft t ,-i.(/-i,/j))( d ( a: > 


> [ Uj(h t >-i,x,s)6( h ,,/'))(d(®,s)) - ^5. 

•^n,n>t' (XmXSm) 
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Therefore, for A* 1 -almost all hy -1 G Hy— 1 , 




Ujihy-ux, s)Q { h t ,_ liU _ j j j)) { d(x, s)) 


rim>t'x S m ) 

which implies that {/fcj}ig/ is a subgame-perfect equilibrium. 

Then we show that for Ao-almost all ho G Ho, 

ci(h 0 ) = / u(h 0 ,x,s)Qr ho j)(d(x,s)). 

•J rim> 1 {Xm X S m ) 

As shown in (1), for any positive integer M, there exists a strategy profile £ such 
that for Ao-almost all ho G Ho, 


ci 


(ho) = [ 

Jv 


Ylm>l(Xrn xSm ) 


u(ho,x,s)e( ho j')(d(x,s)), 


where f k is /& if k < M. and £fc if k > M +1. Since the game is continuous at infin¬ 
ity Jrw^xs™) U ( h °’ X ’ s )e(ho,fM x ’ s )) and Iu m >^mX Srn ) u ( h 0 ,x, s)g {ho j,)( d(z, a)) 
are arbitrarily close when M is sufficiently large. Thus, for Ao-almost all ho G Ho, 

ci (ho) = / u(h 0 ,z,sW 0i/) (d(a;,s)). 


This completes the proof. 


□ 


For t > 1 and ht-\ G H t ~ i, recall that E t (ht- 1 ) is the set of payoff vectors of 
subgame-perfect equilibria in the subgame ht—\. Then we shall show the following 
lemma. 

Lemma 22. For any t >1, E t (ht- 1 ) = <3t°(ht_i) /or A* 1 -almost all h t -\ G H t -\. 

Proof. (1) We will first prove the following claim: for any t and r, if Et+i(ht) C 
Q[ +1 (hf) for A*-almost all h* G ihi, then E t (ht- 1 ) C Qf(h t - 1 ) for A i-1 -almost all 
ht_i G H t _\. We only need to consider the case that t < t. 

By the construction of <3?((2/ +1 ) in Subsection 5.3.1, there exists a measurable 
subset S* -1 C S* -1 with A* -1 (S* -1 ) = 1 such that for any q and h*_i = 
(a/ -1 ,s* -1 ) G H t -1 with s* -1 G S'* -1 , if 

1. c* = X 4t ( /lt _ 1 ) J St qt+i(ht-i,xt,st)fto(dst\ht-i)a(dx t ), where g t+ i(ht_i,-) is 
measurable and gt+i(ht_i, xt, St) G (J/ +1 (ht_i, xt, sj) for At-almost all s* G S* 
and xi G A t (h t - 1 ); 
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2 . a € ®i & iM.(A t i{h t -i)) is a Nash equilibrium in the subgame ht-i with payoff 
f St qt+i{h t -i, •,s t )/to(ds t |/it_i) and action space Yl ieI A u (h t -i), 

then c t G $(Ql +1 )(ht- 1 ). 

Fix a subgame ht-i = 1 ) such that s* -1 G S*. Pick a point 

q € There exists a strategy profile / such that / is a subganre-perfect 

equilibrium in the subgame ht -1 and the payoff is q. Let ct+i(ht-i,xt,st) be the 
payoff vector induced by {fu}i£i in the subgame ( ht,xt,st ) G Gr(At) x St- Then 
we have 

!■ c t = J At ( ht i) f St ct + i{ht-i,x t ,s t )fto{ds t \ht-i)ft(dx t \ht-iy, 

2. f t (-\h t -i) is a Nash equilibrium in the subgame ht -1 with action space 
A t {ht-i) and payoff J St ct+i(h t -i, ■, s t )fto(ds t \h t -i). 

Since / is a subganre-perfect equilibrium in the subgame h t -i, ct+i(h t -i, xt, St) G 
Et+i(ht-i,x t ,s t ) C QJ +1 (ht-i,xt,s t ) for A t -almost all s t G S t and x t G A t (h t -i), 
which implies that q G &(Ql +1 )(ht- 1 ) = Q1(ht- 1 ). 

Therefore, E t (ht- 1 ) C QJ(ht-i) for A* -1 -almost all ht-i G H t -\. 

(2) For any t > r, E t C If t < r, we can start with T t+ j C and repeat 

the argument in (1), then we can show that Et(ht~ i) C QJ(ht- 1 ) for A <-1 -almost 
all h t -i G H t - 1 - Thus, E t (h t - 1 ) C for A* -1 -almost all ht- 1 G H t -\. 

(3) Suppose that q is a measurable selection from < F(Q^. 1 ). Apply Proposi¬ 

tion 5 recursively to obtain Borel measurable mappings {/&*}*£/ for k > t. By 
Lemma 21, ct(ht~ i) is a subgame-perfect equilibrium payoff vector for A* -1 -almost 
all ht-i G H t - 1 - Consequently, C E t (h t - 1 ) for A* - 1 -almost all 

ht—i G H t - 1- 

By Lemma 20, E t (h t - 1 ) = Qt°(ht- 1 ) = $(Qi+i)(frt-i) for A* -1 -almost all 
fo-i G H t _ i. □ 

Therefore, we have proved Theorem 1 and Proposition 1. 

5.4 Proof of Proposition 2 

We will highlight the needed changes in comparison with the proofs presented in 
Subsections 5.3.1-5.3.3. 

1. Backward induction. We first consider stage t with Nt = 1. 

If N t = 1, then S t = {s*}. Thus, P t {h t -i,x t ) = Q t +i{h t -\, x t , s t ), which is 
nonempty and compact valued, and essentially sectionally upper hemicontinuous 
on X f x S'* -1 . Notice that Pt may not be convex valued. 

We first assume that Pt is upper hemicontinuous. Suppose that j is the player 
who is active in this period. Consider the correspondence : Ht -1 —> M n x 
M(Xt) x A(X t ) defined as follows: (v,a,/E) G <&t(ht- 1 ) if 
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1. v = pt(ht-i,A t ^_j^(ht-i),x^j) such that pt(ht~ 1 , •) is a measurable selection 
of P t {h t -i, -); 29 

2. x*j G A t j(h t -\) is a maximization point of player j given the payoff function 
Ptj(ht-i,A t (_fi(ht-i),-) and the action space A tj (h t -i), at = S Ati ( ht _^ for 
i / j and a 3 = S x *.; 

3. /r = Sp^ht-iAn-j^ht-A^lj)- 

This is a single agent problem. We need to show that is nonempty and compact 
valued, and upper hemicontinuous. 

If Pt is nonempty, convex and compact valued, and upper hemicontinuous, then 
we can use Lemma 16, the main result of Simon and Zame (1990), to prove the 
nonemptiness, compactness, and upper hemicontinuity of <f>£. In Simon and Zame 
(1990), the only step they need the convexity of Pt for the proof of their main 
theorem is Lemma 2 therein. However, the one-player pure-strategy version of their 
Lemma 2, stated in the following, directly follows from the upper hemicontinuity 
of Pt without requiring the convexity. 

Let Z be a compact metric space, and {z n } n >o C Z. Let P : Z —> R + be 
a bounded, upper hemicontinuous correspondence with nonempty and 
compact values. For each n > 1, let q n be a Borel measurable selection 
of P such that q n (z n ) = d n . If z n converges to zq and d n converges to 
some do, then do G P(zo)- 

Repeat the argument in the proof of the main theorem of Simon and Zame 
(1990), one can show that is nonempty and compact valued, and upper 
hemicontinuous. 

Then we go back to the case that Pt is nonempty and compact valued, 
and essentially sectionally upper hemicontinuous on X 1 x S'* -1 . Recall that we 
proved Proposition 4 based on Lemma 16. If Pt is essentially sectionally upper 
hemicontinuous on X t x S' 4 1 , we can show the following result based on a similar 
argument as in Subsections 5.2: there exists a bounded, measurable, nonempty 
and compact valued correspondence from Ht-i to M n x Ai(Xt) x A (Xt) such 
that <f>t is essentially sectionally upper hemicontinuous on X x , S'* -1 , and for 
A <_1 -almost all ht ~i G H t - 1 , (v,a,p) G &t(h t - 1 ) if 

1. v = pt(h t -i, x^j) such that pt{h t - 1 , •) is a measurable selection 

of P t {h t - 1 , •); 

2. x*j G Atj(ht-i) is a maximization point of player j given the payoff function 
Ptj{h t -i,A t (_fi{ht- 1 ),-) and the action space A tj (h t - 1 ), a, = S Ati ( ht _ for 
i / j and a 3 = 5 X *.; 

29 Note that A t ^_^ is point valued since all players other than j are inactive. 
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3- At fipt(h t -i,A t (_j)(ht-i),Xtj )• 

Next we consider the case that N t = 0. Suppose that the correspondence 
Qt+i from H t to M n is bounded, measurable, nonempty and compact valued, and 
essentially sectionally upper hemicontinuous on X 1 x S'*. For any (ht-i, xt, §t) E 
Gr(l t ), let 


Rt(h t -i,x t ,s t ) = / Qt+i(ht-i,xt,st,s t )fto(dst\ht-i,xt,st) 
J s t 


= / Qt + i(ht-i,xt,st,st)ipto{ht-i,x t ,s t ,st)\t(ds t ). 
J St 


I St 

Then following the same argument as in Section 5.3.1, one can show that Rt 
is a nonempty, convex and compact valued, and essentially sectionally upper 
hemicontinuous correspondence on X t x S t . 

For any h t -i E H t - 1 and Xt E A t (ht- 1 ), let 

P t (h t -i,x t ) = Rt(ht-i,xt,st)fto(ds t \ht-i,x t ). 

J Ato(ht-i,x t ) 

By Lemma 7, Pt is nonempty, convex and compact valued, and essentially 
sectionally upper hemicontinuous on X t x S'* -1 . The rest of the step remains 
the same as in Subsection 5.3.1. 

2. Forward induction: unchanged. 


3. Infinite horizon: we need to slightly modify the definition of E ™' 1 for any 
m\ > t > 1. Fix any t > 1. Define a correspondence as follows: in the subgame 
ht- i, 

E*(h,_i) = (MiAtiht-t)) o ftoiht-i, •)) ® A*. 

For any ?ni > t, suppose that the correspondence E ™ 1-1 has been defined. Then we 
can define a correspondence E™ 1 : H f -\ — * A4 {j\ t<m<rni {X m x S m )) as follows: 


jm i 

u t 


(ht— l) —{ 5 (^— 1 ) ^ {hi— 1 , •) o fmio(ht—i j •)) ® 

g is a Borel measurable selection of H™ 1-1 , 

^7711 ^ Borel measurable selection of ^/\(A. mi)} 


Then the result in Subsection 5.3.3 is true with the above E™ 1 . 
Consequently, a subgame-perfect equilibrium exists. 
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5.5 Proof of Proposition 3 

We will describe the necessary changes in comparison with the proofs presented in 
Subsections 5.3.1-5.3.3 and 5.4. 

1. Backward induction. For any t > 1, suppose that the correspondence 
Qt+i from H t to W 1 is bounded, nonempty and compact valued, and upper 
hemicontinuous on X 1 . 

If N t = 1, then S t = {s t }. Thus, P t (h t -i,x t ) = Q t +i(h t -i, x t , s t ), which 
is nonempty and compact valued, and upper hemicontinuous. Then define the 
correspondence from H t -\ to W 1 x M(X t ) x A(X t ) as (v,a, p) G 1 ) if 

1. v = pt(ht-i, (ht~i), x*j) such that pt(ht- 1 ,-) is a measurable selection 

of P t (ht- 1 , •); 

2. x*j G Atj{ht- 1 ) is a maximization point of player j given the payoff function 

ptj{h t -i, A t (_j)(h t _i), ■) and the action space A tj (h t - 1 ), = 6 Au{ h t l) for 

i / j and aij = 5 X *.; 

3. /r = 

As discussed in Subsection 5.4, is nonempty and compact valued, and upper 
hemicontinuous. 

When N t = 0, for any ht- 1 € H t -1 and xt G A t (ht- 1 ), 

P t {h t -i,x t )= / Qt+i{h t -i,xt,st)fto(dst\ht-i,xt). 

J A t o(ht-i,xt) 

Let coQt+i(ht~i,xt,st) be the convex hull of Qt+i(ht-i,xt, st). Because Qt+i is 
bounded, nonempty and compact valued, coQf+i is bounded, nonempty, convex 
and compact valued. By Lemma 3 (8), coQt+i is upper hemicontinuous. 

Notice that fto{'\ht-i,xt) is atomless and Qt+i is nonempty and compact 
valued. By Lemma 5, 

Pt(h t -i,x t )= / coQt + i(h t -i,xt,s t )fto{ds t \ht-i,x t ). 

J Ato(h t -i,xt) 

By Lemma 7, Pt, is bounded, nonempty, convex and compact valued, and upper 
hemicontinuous. Then instead of relying on Proposition 4, we now use Lemma 16 
to conclude that is bounded, nonempty and compact valued, and upper 
hemicontinuous. 

2. Forward induction. The first step is much simpler. 

For any {(h^_ 1 , v k )}i<k<oo != G r (4b(Qt+i)) such that (h^_ 1 ,v k ) converges to 
pick (a k ,p, k ) such that (v k ,a k ,n k ) G for 1 < k < oo. Since 

is upper hemicontinuous and compact valued, there exists a subsequence of 
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{y k , a k , /x fc ), say itself, such that (v k ,a k ,/j k ) converges to some (v°°, a°°, € 

3>t(fo“i) due to Lemma 2 (6). Thus, (a 00 ,// 00 ) € v°°), which implies that 

is also upper hemicontinuous and compact valued. By Lemma 3 (3), has a 
Borel measurable selection fit- Given a Borel measurable selection qt of <f>((5t+i), 
one can let (ftifit- 1 ) = (qt(ht-i), Qt(ht-i)))• Then fit is a Borel measurable 

selection of 

Steps 2 and 3 are unchanged. 

3. Infinite horizon. We do not need to consider Effi' 1 for any mi > t > 1. 
Instead of relying on Lemma 13, we can use Lemma 9 (3) to prove Lemma 18. The 
proof of Lemma 19 is much simpler. Notice that the boundedness, nonemptiness, 
compactness and upper hemicontinuity of QJ for the case t > t is immediate. Then 
one can apply the backward induction as in Lemma 19 to show the corresponding 
properties of Qf for the case t < r. Following the same arguments, one can show 
that Lemmas 20-22 now hold for all ht~\ € Ht -1 and all t > 1. 
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